-- Logs begin at Wed 2022-06-15 13:48:11 UTC, end at Wed 2022-06-15 15:05:05 UTC. -- Jun 15 14:34:10.111520 dv-cinder-843277-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 15 14:34:10.124535 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 15 14:34:10.124535 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 14:34:10 2022] *** Jun 15 14:34:10.124535 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 14:34:10.124535 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 14:34:10.124535 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: nodename: dv-cinder-843277-3-iscsi Jun 15 14:34:10.124535 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: machine: x86_64 Jun 15 14:34:10.124535 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: clock source: unix Jun 15 14:34:10.124535 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: pcre jit disabled Jun 15 14:34:10.124535 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: detected number of CPU cores: 4 Jun 15 14:34:10.124535 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: current working directory: / Jun 15 14:34:10.124535 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: detected binary path: /usr/bin/uwsgi-core Jun 15 14:34:10.124535 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: your processes number limit is 47680 Jun 15 14:34:10.124535 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: your memory page size is 4096 bytes Jun 15 14:34:10.124535 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: detected max file descriptor number: 2048 Jun 15 14:34:10.124535 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: lock engine: pthread robust mutexes Jun 15 14:34:10.124535 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: thunder lock: enabled Jun 15 14:34:10.124535 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 15 14:34:10.124535 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 14:34:10.169309 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: Python main interpreter initialized at 0x56280503c9c0 Jun 15 14:34:10.169309 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: python threads support enabled Jun 15 14:34:10.169309 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: your server socket listen backlog is limited to 100 connections Jun 15 14:34:10.169309 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: your mercy for graceful operations on workers is 90 seconds Jun 15 14:34:10.169682 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 14:34:10.169763 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: *** Operational MODE: preforking *** Jun 15 14:34:10.169987 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: *** uWSGI is running in multiple interpreter mode *** Jun 15 14:34:10.169987 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: spawned uWSGI master process (pid: 109790) Jun 15 14:34:10.170195 dv-cinder-843277-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 15 14:34:10.171293 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: spawned uWSGI worker 1 (pid: 109791, cores: 1) Jun 15 14:34:10.171293 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: spawned uWSGI worker 2 (pid: 109792, cores: 1) Jun 15 14:34:10.171293 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 14:34:10.847965 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 14:34:10.855498 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 14:34:12.039904 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:34:12.039904 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: from cryptography.utils import int_from_bytes Jun 15 14:34:12.041170 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:34:12.041170 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: from cryptography.utils import int_from_bytes Jun 15 14:34:12.044628 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:34:12.044628 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: from cryptography.utils import int_from_bytes Jun 15 14:34:12.045156 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:34:12.045156 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: from cryptography.utils import int_from_bytes Jun 15 14:34:14.623959 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 14:34:14.624644 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 14:34:14.625006 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 14:34:14.625100 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 14:34:14.625190 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 14:34:14.625281 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 14:34:14.625373 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 14:34:14.625460 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 14:34:14.625544 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 14:34:14.625632 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 14:34:14.625890 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.625982 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.626147 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.626235 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.626322 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.626406 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.626647 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.626756 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.626977 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.627080 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.627285 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.627381 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.627604 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.627704 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.627921 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.628020 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.628299 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.629333 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.629445 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.629532 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.629615 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.629714 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.629813 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843277-3-iscsi {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.630017 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.630115 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843277-3-iscsi {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.630327 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.630425 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.630637 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.630732 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.630950 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.631035 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.631253 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.631342 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.631564 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.631648 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.631868 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.631952 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.632184 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.632363 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.632688 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.632843 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.633001 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.633120 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.633323 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.633460 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.633688 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.633827 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.633968 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.634087 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.634298 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.634437 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.634586 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.634692 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.634910 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.635013 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.635217 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.635310 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.635540 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.635638 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.635850 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.635948 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843277-3-iscsi {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.636241 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.636327 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843277-3-iscsi {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.636555 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.636646 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.636866 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.636954 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.637178 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.637268 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.637575 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.637690 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.637912 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.638007 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.638221 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.638316 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.638543 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.638629 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.638850 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.638940 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.639175 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.639267 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.639499 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.639590 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.639818 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.639904 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.640136 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.640229 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.640442 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.640534 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.640752 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.640858 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.641056 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.641161 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.641362 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.641456 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.641684 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.641782 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.641997 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.642102 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.642247 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.642339 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.642541 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.642633 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.642850 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.642936 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.643171 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.643262 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.643489 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.643580 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.643741 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.643862 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.644646 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.644795 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.644888 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.645006 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.645154 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.645328 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.645459 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.645676 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.645828 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.645982 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.646079 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.646291 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.646383 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.646600 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.646697 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.646907 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.646998 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.647214 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.647314 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.647521 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.647623 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.647828 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.647921 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.648135 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.648229 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.648453 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.648550 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.648761 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.648852 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.649081 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.649166 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.649389 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.649486 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.649733 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.649833 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.650046 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.650130 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.650381 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.650471 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.650691 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.650790 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.651001 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.651097 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.651317 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.651405 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.651635 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.651727 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.651941 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.652034 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.652247 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.652334 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.652555 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.652641 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.652859 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.652949 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.653166 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.653254 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.653485 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.653571 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.653768 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.653918 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.654074 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.654167 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.654372 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.654463 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.654674 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.654769 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.654981 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.655089 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.655281 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.655374 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.655586 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.655683 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.655884 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.655975 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.656188 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.656272 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.656488 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.656583 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.656791 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.656876 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.657093 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.657185 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.657395 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.657495 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.657715 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.657814 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.658022 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.658114 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.658327 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.658412 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.658629 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.658714 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.658933 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.659025 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.659236 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.659323 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.659607 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.660239 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.660410 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.660527 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.660718 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.660835 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.661031 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.661142 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.661353 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.661455 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.661682 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.661788 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.661988 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.662087 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.662311 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.662401 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.662619 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.662716 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.662927 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.663017 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.663246 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.663336 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.663548 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.663644 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.663853 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.663965 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.664157 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.664256 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.664459 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.664554 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.664765 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.664855 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.665063 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.665175 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.665369 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.665458 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.665714 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.665803 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.665995 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.666097 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.666296 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.666381 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.666597 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.666688 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.666897 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.666989 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.667196 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.667282 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.667496 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.667580 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.667792 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.667885 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.668090 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.668184 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.668389 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.668474 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.668705 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.668798 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.669008 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.669098 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.669317 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.669408 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.669622 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.669742 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.669949 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.670036 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.670270 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:34:14.670355 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.670603 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.670696 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.670933 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.671024 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.671269 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.671367 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.671579 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.671671 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.671908 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.672004 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.672221 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.672315 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.672534 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.672620 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.672842 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.672933 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.673157 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.673252 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.673465 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.673549 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.673801 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.673889 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.674113 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.674219 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.674422 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.674507 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.674738 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.674848 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.675053 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.675207 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.675397 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.675527 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.675717 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.675874 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.676025 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.676131 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.676338 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.676423 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.676648 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.676734 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.676966 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.677060 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.677275 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.677367 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.677601 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.677720 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.677937 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.678030 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.678277 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.678363 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.678605 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.678692 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.678923 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.679008 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.679240 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.679325 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.679553 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.679639 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.679863 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.679948 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.680174 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.680260 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.680488 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.680575 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.680808 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.680893 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.681129 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.681241 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.681441 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.681538 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.681774 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.681863 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.682085 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.682182 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.682396 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.682491 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.682704 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.682790 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.683014 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.683104 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.683326 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.683421 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.683646 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.683737 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.683959 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.684045 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.684275 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.684386 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.684586 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.684671 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.684900 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.684993 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.685212 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.685364 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.685521 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.685615 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.685854 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.685941 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.686160 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.686252 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.686465 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.686556 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.686771 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.686855 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.687079 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.687165 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.687388 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.687480 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.687703 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.687796 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.688029 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.688115 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.688335 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.688421 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.688647 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.688733 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.688958 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.689044 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.689268 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.689354 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.689572 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.689695 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.689906 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.690001 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.690216 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.690302 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.690524 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.690622 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.690876 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.690966 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.691184 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.691326 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.691508 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.691647 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.691821 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.691978 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.692129 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.692291 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.692451 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.692601 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.692760 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.692920 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.693069 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.693240 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.693384 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.693548 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.693718 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.693889 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.694033 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.694203 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.694351 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.694536 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.694661 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.694851 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.694988 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.695166 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.695305 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.695503 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.695619 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.695840 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.695959 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.696150 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.696276 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.696478 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.696578 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.696807 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.696893 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.697128 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.697216 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.697436 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.697521 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.697771 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.697859 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.698083 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.698171 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.698391 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.698477 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.698698 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.698783 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.699009 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.699094 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.699318 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.699402 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.699621 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.699712 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.699926 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.700013 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.700235 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.700319 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.700582 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.700683 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.700842 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.700928 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.701161 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.701245 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.701468 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.701606 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.701796 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.701891 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.702101 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.702193 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.702404 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.702497 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.702746 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.702838 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.703051 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.703146 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.703394 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.703562 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.703719 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.703814 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.704036 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.704121 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.704348 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.704455 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.704660 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.704762 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.704967 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.705052 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.705275 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.705361 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.705587 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.705707 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.705919 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.706013 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.706238 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.706863 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.707206 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.707292 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.707522 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.707616 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.707844 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.707931 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.708155 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.708250 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.708481 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.708585 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.708793 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.708879 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.709110 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.709196 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.709415 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.709508 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.709731 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.709820 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.710073 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.710158 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.710433 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.710534 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.710752 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.710845 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.711062 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.711147 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.711374 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.711472 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.711682 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.712045 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.712276 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.712360 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.712585 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.712682 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.712893 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.712992 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.713204 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.713295 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.713513 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.713598 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.713846 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.713931 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.714166 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.714251 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.714477 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.714564 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.714788 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.714883 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.715097 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.715182 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.715399 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.715496 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.715705 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.715797 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.716019 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.716112 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.716345 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.716431 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.716655 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.716746 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.716971 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.717065 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.717282 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.717366 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.717593 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.717738 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.717929 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.718023 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.718242 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.718331 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.718548 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.718634 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.718852 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.718949 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.719158 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.719244 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.719468 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.719554 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.719781 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.719874 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.720091 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.720176 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.720396 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.720481 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.720697 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.720782 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.721006 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.721090 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.721311 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.721396 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.721615 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.721718 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.721981 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.722101 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.722882 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.722987 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.723255 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.723333 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.723571 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.723655 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.723893 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.723977 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.724202 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.724299 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.724504 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.724589 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.724814 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.724940 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.725128 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.725224 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.725435 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.725522 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.725760 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.725862 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.726065 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.726150 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.726368 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.726468 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.726709 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.726808 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.727016 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.727101 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.727319 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.727403 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.727634 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.727732 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.727945 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.728030 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.728252 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.728336 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.728562 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.728656 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.728870 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.728954 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.729179 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.729265 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.729494 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.729580 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.729840 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.729937 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.730155 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.730241 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.730465 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.730551 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.730774 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.730859 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.731082 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.731166 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.731392 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.731478 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.731703 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.731788 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.732010 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.732097 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.732318 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.732404 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.732625 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.732717 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.732927 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.733019 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.733237 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.733330 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.733554 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.733830 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.734144 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.734307 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.734475 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.734725 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.734806 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.734906 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.735098 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.735204 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.735413 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.735498 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.735729 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.735814 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.736060 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.736145 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.736383 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.736468 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.736697 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.736790 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.737011 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.737107 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.737318 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.737412 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.737648 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.737830 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.737988 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.738078 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.738304 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.738404 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.738610 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.738703 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.738917 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.739004 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.739221 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.739315 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.739529 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.739615 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.739833 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.739926 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.740143 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.740230 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.740445 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.740541 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.740751 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.740838 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.741054 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.741139 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.741355 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.741440 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.741703 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.741792 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.741983 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.742070 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.742300 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.742391 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.742607 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.742693 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.742907 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.742993 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.743209 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.743294 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.743510 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.743603 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.743846 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.743931 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.744149 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.744234 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.744487 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.744580 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.744816 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.744903 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.745129 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.745245 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.745436 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.745546 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.745793 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.745921 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.746091 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.746186 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.746407 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.746502 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.746696 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.746797 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.746996 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.747082 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.747304 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.747390 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.747607 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.747694 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.747906 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.747992 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.748212 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.748298 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.748518 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.748604 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.748825 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.748909 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.749129 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.749215 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.749429 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.749519 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.749766 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.749866 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.750067 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.750153 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.750376 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.750460 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.750679 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.750775 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.750980 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.751064 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.751281 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.751373 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.751587 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.751682 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.751893 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.751979 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.752195 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.752280 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.752497 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.752589 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.752795 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.752888 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.753107 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.753208 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.753457 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.753544 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.753876 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.753973 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.754184 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.754273 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.754495 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.754589 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.754802 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.754888 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.755104 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.755188 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.755427 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.755516 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.755733 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.755817 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.756040 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.756151 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.756345 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.756443 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.756648 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.756755 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.756951 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.757050 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.757253 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.757359 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.757566 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.757695 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.757906 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.758079 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.758218 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.758320 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.758521 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.758606 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.758828 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.758922 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.759135 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.759222 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.759439 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.759524 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.759745 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.759839 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.760049 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.760134 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.760353 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.760436 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.760657 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.760743 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.760962 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.761059 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.761266 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.761350 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.761568 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.761654 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.761917 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.762006 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.762221 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.762307 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.762522 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.762614 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.762825 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.762909 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.763127 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.763218 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.763465 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.763558 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.763771 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.763855 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.764122 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.764214 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.764429 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.764513 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.764746 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.764840 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.765059 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.765153 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.765370 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.765456 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.765699 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.765787 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.766010 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.766125 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.766314 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.766403 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.766625 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.766709 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.766934 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.767062 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.767239 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.767324 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.767542 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.767637 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.767847 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.767945 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.768161 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.768253 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.768471 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.768557 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.768783 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.769438 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.769681 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.769823 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.770116 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.770263 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.770363 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.770443 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.770662 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.770748 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.770973 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.771058 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.771283 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.771370 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.771591 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.771676 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.771900 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.771984 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.772209 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.772333 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.772522 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.772609 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.772832 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.772926 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.773144 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.773235 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.773455 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.773539 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.773784 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.773885 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.774094 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.774186 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.774402 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.774487 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.774711 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.774805 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.775019 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.775105 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.775335 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.775420 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.775643 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.775742 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.775947 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.776033 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.776252 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.776337 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.776555 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.776647 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.776861 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.776947 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.777165 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.777289 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.777589 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.777710 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.777950 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.778042 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.778235 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.778322 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.778538 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.778623 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.778849 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.778934 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.779159 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.779243 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.779474 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.779560 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.779781 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.779866 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.780084 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.780186 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.780500 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.780586 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.780813 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.780905 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.781124 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.781216 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.781429 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.781515 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.781753 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.781840 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.782060 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.782158 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.782372 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.782458 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.782678 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.782764 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.782986 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.783081 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.783290 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.783375 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.783596 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.783682 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.783908 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.784001 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.784216 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.784308 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.785163 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.785261 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.785477 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.785563 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.785816 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.785906 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.786201 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.786288 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.786541 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.786626 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.786855 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.786941 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.787185 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.787278 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.787512 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.787599 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.787840 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.787933 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.788150 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.788314 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.788463 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.788562 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.788776 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.788863 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.789089 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.789174 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.789417 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.789505 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.789756 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.789860 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.790081 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.790175 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.790393 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.790488 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.790703 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.790788 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.791029 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.791114 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.791347 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.791450 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.791660 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.791753 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.791981 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.792067 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.792387 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.792481 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.792700 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.792788 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.793010 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.793095 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.793333 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.793421 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.793640 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.793831 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.793973 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.794061 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.794277 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.794371 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.794584 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.794670 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.794891 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.794978 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.795201 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.795296 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.795511 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.795605 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.795823 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.795908 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.796134 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.796221 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.796444 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.796583 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.796750 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.796845 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.797055 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.797141 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.797362 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.797448 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.797679 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.797783 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.798002 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.798088 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.798321 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.798404 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.798629 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.798786 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.798934 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.799027 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.799249 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.799334 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.799553 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.799646 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.799875 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.799966 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.800251 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.800406 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.800544 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.800681 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.800909 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.801055 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.801257 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.801416 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.801574 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.801760 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.801905 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.802051 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.802222 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.802373 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.802535 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.802652 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.802851 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.802929 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.803188 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.803280 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.803518 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.803614 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.803840 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.803926 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.804163 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.804258 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.804481 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.804566 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.804787 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.804877 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.805095 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.805190 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.805398 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.805482 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.805724 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.805852 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.806034 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.806135 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.806339 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.806426 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.806646 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.806732 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.806948 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.807050 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.807248 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.807334 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.807553 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.807642 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.807857 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.807946 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.808173 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.808258 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.808476 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.808561 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.808797 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.808882 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.809105 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.809197 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.809411 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.809640 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.809811 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.809897 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.810042 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.810129 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.810374 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.810460 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.810685 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.810777 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.811018 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.811103 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.811335 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.811429 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.811660 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.811753 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.811971 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.812063 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.812285 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.812380 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.812603 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.812695 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.812918 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.813003 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.813234 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.813331 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.813551 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.813637 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.813892 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.813978 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.814208 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.814303 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.814522 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.814617 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.814830 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.814921 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.815138 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.815224 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.815452 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.815536 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.816287 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.816382 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.816605 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.816862 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.817161 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.817247 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.817483 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.817623 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.817827 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.817924 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.818146 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.818248 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.818464 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.818558 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.818781 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.818876 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.819096 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.819188 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.819410 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.819503 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.819721 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.819808 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.820034 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.820120 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.820345 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.820440 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.820677 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.820763 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.820999 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.821083 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.821328 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.821422 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.821647 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.821764 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.821990 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.822077 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.822306 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.822393 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.822622 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.822708 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.822937 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.823023 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.823291 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.823414 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.823603 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.823697 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.823908 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.824002 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.824224 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.824309 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.824538 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.824623 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.824851 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.824945 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.825163 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.825249 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.825471 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.825556 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.825810 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.825899 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.826143 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.826266 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.826496 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.826616 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.826752 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.826852 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.827066 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.827151 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.827379 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.827464 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.827705 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.827792 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.828027 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.828112 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.828345 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.828506 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.828659 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.828744 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.828973 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.829058 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.829288 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.829497 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.829839 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.829951 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.830159 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.830266 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.830495 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.830602 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.830829 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.830927 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.831156 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.831260 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.832036 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.832152 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.832375 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.832471 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.832707 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.832812 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.833017 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.833114 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.833324 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.833444 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.833639 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.833799 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.833970 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.834059 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.834277 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.834363 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.834599 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.834874 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.835007 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.835113 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.835236 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.835318 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.835513 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.835613 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.835824 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.836047 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.836358 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.836444 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.836706 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.837068 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.837292 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.837379 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.837619 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.837747 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.837968 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.838067 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.838280 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.838366 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.838589 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.838681 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.838902 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.838999 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.839207 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.839292 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.839515 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.839607 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.839832 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.839974 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.840139 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.840224 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.840444 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.840535 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.840757 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.840844 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.841066 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.841151 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.841371 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.841456 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.841688 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.841786 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.842002 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.842087 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.842305 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.842390 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.842625 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.842711 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.842932 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.843017 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.843238 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.843324 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.843543 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.843637 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.843848 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.843940 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.844153 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.844247 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.844459 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.844545 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.844764 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.844856 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.845069 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.845168 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.845374 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.845459 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.845690 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.845778 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.846007 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.846102 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.846311 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.846397 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.846619 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.846748 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.846922 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.847038 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.847284 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.847441 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.847628 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.847728 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.847936 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.848025 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.848243 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.848336 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.848551 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.848644 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.848864 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.848951 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.849174 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.849260 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.849491 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.849583 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.849834 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.849932 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.850148 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.850244 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.850490 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.850576 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.850817 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.851027 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.851355 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.851442 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.851677 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.851771 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.852002 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.852094 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.852336 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.852423 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.852648 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.852742 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.852960 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.853046 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.853267 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.853353 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.853577 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.853695 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.853921 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.854006 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.854233 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.854318 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.854547 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.854644 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.854858 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.854943 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.855169 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.855254 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.855479 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.855573 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.855788 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.855880 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.856098 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.856183 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.856407 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.856493 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.856714 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.856799 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.857024 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.857118 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.857334 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.857421 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.857642 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.857756 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.857972 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.858068 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.858289 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.858375 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.858618 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.858704 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.858935 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.859093 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.859253 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.859338 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.859568 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.859655 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.859880 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.859974 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.860193 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.860281 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.860499 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.860585 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.860810 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.860898 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.861117 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.861208 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.861435 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.861521 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.861775 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.861865 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.862086 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.862174 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.862392 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.862506 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.862853 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.862957 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.863165 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.863269 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.863483 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.863578 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.863798 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.863893 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.864107 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.864199 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.864432 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.864527 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.864743 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.864829 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.865055 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.865140 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.865368 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.865466 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.865693 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.865782 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.866030 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.866128 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.866374 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.866460 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.866701 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.866788 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.867011 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.867098 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.867319 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.867406 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.867623 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.867716 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.867931 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.868018 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.868246 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.868333 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.868557 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.868646 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.868866 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.868959 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.869169 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.869255 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.869474 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.869559 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.869806 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.869911 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.870113 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.870206 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.870417 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.870512 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.870720 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.870818 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.871022 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.871107 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.871324 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.871408 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.871625 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.871718 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.871926 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.872010 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.872228 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.872313 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.872531 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.872623 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.872832 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.872917 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.873136 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.873222 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.873439 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.873525 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.873769 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.873870 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.874073 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.874158 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.874375 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.874461 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.874676 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.874769 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.874977 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.875061 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.875308 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.875396 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.875629 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.875720 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.875944 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.876038 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.876257 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.876343 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.876569 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.876655 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.876886 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.876984 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.877202 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.877286 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.877524 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.877609 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.877870 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.877966 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.878182 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.878785 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.879019 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.879122 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.879332 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.879433 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.879654 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.879741 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.879968 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.880101 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.880281 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.880364 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.880595 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.880682 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.880905 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.880998 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.881218 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.881311 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.881548 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.881634 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.881886 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.881975 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.882198 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.882284 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.882522 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.882614 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.882838 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.882932 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.883155 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.883239 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.883469 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.883561 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.883786 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.883881 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.884104 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.884189 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.884418 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.884503 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.884733 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.884828 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.885044 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.885129 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.885356 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.885448 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.885692 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.885798 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.886011 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.886103 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.886327 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.886412 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.886656 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.886741 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.886969 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.887056 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.887280 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.887371 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.887607 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.887693 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.887933 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.888019 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.888263 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.888348 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.888590 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.888677 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.888930 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.889023 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.889249 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.889344 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.889566 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.889651 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.889905 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.889992 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.890151 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 14:34:14.890249 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:34:14.890447 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 14:34:14.952708 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO dbcounter [None req-1d6cb39d-3796-4a88-80b2-c49b5d5070c6 None None] Registered counter for database nova_api Jun 15 14:34:14.952874 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO dbcounter [None req-eff31cd5-672d-4413-9b40-1f788fab8952 None None] Registered counter for database nova_api Jun 15 14:34:14.974382 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_db.sqlalchemy.engines [None req-1d6cb39d-3796-4a88-80b2-c49b5d5070c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:34:14.977302 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG oslo_db.sqlalchemy.engines [None req-eff31cd5-672d-4413-9b40-1f788fab8952 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:34:14.980947 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writer thread running {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:34:14.983880 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG dbcounter [-] [109791] Writer thread running {{(pid=109791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:34:15.039835 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.context [None req-1d6cb39d-3796-4a88-80b2-c49b5d5070c6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2a02d676-298d-47a3-8b1e-38c9694b2603(cell1) {{(pid=109792) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 14:34:15.041907 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.context [None req-eff31cd5-672d-4413-9b40-1f788fab8952 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2a02d676-298d-47a3-8b1e-38c9694b2603(cell1) {{(pid=109791) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 14:34:15.043993 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-1d6cb39d-3796-4a88-80b2-c49b5d5070c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:34:15.045559 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-1d6cb39d-3796-4a88-80b2-c49b5d5070c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:34:15.045985 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG oslo_concurrency.lockutils [None req-eff31cd5-672d-4413-9b40-1f788fab8952 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:34:15.046412 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-1d6cb39d-3796-4a88-80b2-c49b5d5070c6 None None] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:34:15.047545 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG oslo_concurrency.lockutils [None req-eff31cd5-672d-4413-9b40-1f788fab8952 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:34:15.048359 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG oslo_concurrency.lockutils [None req-eff31cd5-672d-4413-9b40-1f788fab8952 None None] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:34:15.048466 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-1d6cb39d-3796-4a88-80b2-c49b5d5070c6 None None] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:34:15.050386 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO dbcounter [None req-1d6cb39d-3796-4a88-80b2-c49b5d5070c6 None None] Registered counter for database nova_cell0 Jun 15 14:34:15.050570 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG oslo_concurrency.lockutils [None req-eff31cd5-672d-4413-9b40-1f788fab8952 None None] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:34:15.052529 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO dbcounter [None req-eff31cd5-672d-4413-9b40-1f788fab8952 None None] Registered counter for database nova_cell0 Jun 15 14:34:15.054404 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO dbcounter [None req-1d6cb39d-3796-4a88-80b2-c49b5d5070c6 None None] Registered counter for database nova_cell1 Jun 15 14:34:15.056341 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO dbcounter [None req-eff31cd5-672d-4413-9b40-1f788fab8952 None None] Registered counter for database nova_cell1 Jun 15 14:34:15.062751 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_db.sqlalchemy.engines [None req-1d6cb39d-3796-4a88-80b2-c49b5d5070c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:34:15.067024 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG oslo_db.sqlalchemy.engines [None req-eff31cd5-672d-4413-9b40-1f788fab8952 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:34:15.067904 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writer thread running {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:34:15.068479 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG oslo_db.sqlalchemy.engines [None req-eff31cd5-672d-4413-9b40-1f788fab8952 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:34:15.069514 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_db.sqlalchemy.engines [None req-1d6cb39d-3796-4a88-80b2-c49b5d5070c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:34:15.075681 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG dbcounter [-] [109791] Writer thread running {{(pid=109791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:34:15.077070 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG dbcounter [-] [109791] Writer thread running {{(pid=109791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:34:15.212807 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writer thread running {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:34:15.221504 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO dbcounter [None req-1d6cb39d-3796-4a88-80b2-c49b5d5070c6 None None] Registered counter for database nova_cell0 Jun 15 14:34:15.227322 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO dbcounter [None req-eff31cd5-672d-4413-9b40-1f788fab8952 None None] Registered counter for database nova_cell0 Jun 15 14:34:15.230440 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_db.sqlalchemy.engines [None req-1d6cb39d-3796-4a88-80b2-c49b5d5070c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:34:15.234790 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writer thread running {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:34:15.236015 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG oslo_db.sqlalchemy.engines [None req-eff31cd5-672d-4413-9b40-1f788fab8952 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:34:15.240981 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG dbcounter [-] [109791] Writer thread running {{(pid=109791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:34:15.572962 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: WARNING keystonemiddleware.auth_token [None req-1d6cb39d-3796-4a88-80b2-c49b5d5070c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:34:15.573430 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: WARNING keystonemiddleware.auth_token [None req-eff31cd5-672d-4413-9b40-1f788fab8952 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:34:15.580355 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: WARNING keystonemiddleware.auth_token [None req-1d6cb39d-3796-4a88-80b2-c49b5d5070c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:34:15.580597 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: WARNING keystonemiddleware.auth_token [None req-eff31cd5-672d-4413-9b40-1f788fab8952 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:34:15.921961 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: WARNING keystonemiddleware.auth_token [None req-eff31cd5-672d-4413-9b40-1f788fab8952 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:34:15.922566 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: WARNING keystonemiddleware.auth_token [None req-1d6cb39d-3796-4a88-80b2-c49b5d5070c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:34:15.928364 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: WARNING keystonemiddleware.auth_token [None req-eff31cd5-672d-4413-9b40-1f788fab8952 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:34:15.928786 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: WARNING keystonemiddleware.auth_token [None req-1d6cb39d-3796-4a88-80b2-c49b5d5070c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:34:15.933608 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56280503c9c0 pid: 109791 (default app) Jun 15 14:34:15.933847 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56280503c9c0 pid: 109792 (default app) Jun 15 14:34:15.935697 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-eff31cd5-672d-4413-9b40-1f788fab8952 None None] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:34:15.936882 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-eff31cd5-672d-4413-9b40-1f788fab8952 None None] 10.222.0.57 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001723 Jun 15 14:34:15.937300 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 788 bytes} [Wed Jun 15 14:34:15 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:32.539300 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-1d6cb39d-3796-4a88-80b2-c49b5d5070c6 None None] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:32.540529 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-1d6cb39d-3796-4a88-80b2-c49b5d5070c6 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003101 Jun 15 14:35:32.540922 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 1/2] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 14:35:32 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:32.552027 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG dbcounter [-] [109791] Writing DB stats nova_api:SELECT=3 {{(pid=109791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:32.552967 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG dbcounter [-] [109791] Writing DB stats nova_cell1:SELECT=3 {{(pid=109791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:32.554588 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG dbcounter [-] [109791] Writing DB stats nova_cell0:SELECT=3 {{(pid=109791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:32.556241 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG dbcounter [-] [109791] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:33.005239 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-29a53c3a-f19f-4c5b-bf90-55ec9bd55c54 admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:33.035481 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-29a53c3a-f19f-4c5b-bf90-55ec9bd55c54 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.488461 Jun 15 14:35:33.036023 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 2/3] 10.222.0.57 () {60 vars in 1291 bytes} [Wed Jun 15 14:35:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:35:35.219161 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-1d6cb39d-3796-4a88-80b2-c49b5d5070c6 None None] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:35.220459 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-1d6cb39d-3796-4a88-80b2-c49b5d5070c6 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jun 15 14:35:35.220961 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 2/4] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 14:35:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:35.289205 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-6e7b3d3b-5f4d-4e39-abc7-3ea1cc6c734a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "disk": 1, "name": "cirros256", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "ram": 256}} {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:35.309146 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:35:35.309146 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: warnings.warn(msg) Jun 15 14:35:35.340045 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-6e7b3d3b-5f4d-4e39-abc7-3ea1cc6c734a admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.111840 Jun 15 14:35:35.340786 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 3/5] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Jun 15 14:35:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:35:35.355693 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writing DB stats nova_api:SELECT=3 {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:35.356826 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writing DB stats nova_cell1:SELECT=3 {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:35.357944 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writing DB stats nova_cell0:SELECT=3 {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:35.359120 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:35:35.578710 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-6ff764f7-7129-40aa-a086-50dc50034d98 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:35.584244 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:35:35.584244 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: warnings.warn(msg) Jun 15 14:35:35.653955 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-6ff764f7-7129-40aa-a086-50dc50034d98 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.304168 Jun 15 14:35:35.655885 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 3/6] 10.222.0.57 () {64 vars in 1335 bytes} [Wed Jun 15 14:35:35 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:35:37.874507 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-6e7b3d3b-5f4d-4e39-abc7-3ea1cc6c734a admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:37.875526 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-6e7b3d3b-5f4d-4e39-abc7-3ea1cc6c734a admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jun 15 14:35:37.875964 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 4/7] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 14:35:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:38.004245 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-0b262571-d088-4902-9fad-13994f525909 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds512M", "rxtx_factor": 1.0, "disk": 5, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "d1", "vcpus": 1}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:38.033693 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:35:38.033693 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: warnings.warn(msg) Jun 15 14:35:38.053014 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-0b262571-d088-4902-9fad-13994f525909 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.171247 Jun 15 14:35:38.053569 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 4/8] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Jun 15 14:35:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:35:38.066765 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-9da0e484-b828-4246-af2a-76ebf332761b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:38.068162 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:35:38.068162 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: warnings.warn(msg) Jun 15 14:35:38.099261 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-9da0e484-b828-4246-af2a-76ebf332761b admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036295 Jun 15 14:35:38.100020 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 5/9] 10.222.0.57 () {64 vars in 1335 bytes} [Wed Jun 15 14:35:38 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:35:40.309586 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-0b262571-d088-4902-9fad-13994f525909 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:40.310631 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-0b262571-d088-4902-9fad-13994f525909 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 15 14:35:40.311195 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 5/10] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 14:35:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:40.372919 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-b54aa1f3-6442-49ad-a293-e3eb22347726 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d2", "os-flavor-access:is_public": true, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds1G"}} {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:40.391612 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-b54aa1f3-6442-49ad-a293-e3eb22347726 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074611 Jun 15 14:35:40.392337 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 6/11] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Jun 15 14:35:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:35:40.404077 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-4588257f-20b7-4693-9021-3195a25ad61f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:40.427507 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-4588257f-20b7-4693-9021-3195a25ad61f admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027051 Jun 15 14:35:40.432030 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 6/12] 10.222.0.57 () {64 vars in 1335 bytes} [Wed Jun 15 14:35:40 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:35:42.628232 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-b54aa1f3-6442-49ad-a293-e3eb22347726 admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:42.629333 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-b54aa1f3-6442-49ad-a293-e3eb22347726 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jun 15 14:35:42.629863 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 7/13] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 14:35:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:42.690698 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-76b10e5d-0ffd-44f1-80c7-6c3e86b6cb7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "name": "ds2G", "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d3", "ram": 2048}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:42.711430 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-76b10e5d-0ffd-44f1-80c7-6c3e86b6cb7d admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073795 Jun 15 14:35:42.712098 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 7/14] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Jun 15 14:35:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:35:42.724751 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-58a897d4-d264-4126-8454-5fb9ccdddee8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:42.751208 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-58a897d4-d264-4126-8454-5fb9ccdddee8 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030190 Jun 15 14:35:42.751813 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 8/15] 10.222.0.57 () {64 vars in 1335 bytes} [Wed Jun 15 14:35:42 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:35:44.990942 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-76b10e5d-0ffd-44f1-80c7-6c3e86b6cb7d admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:44.993135 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-76b10e5d-0ffd-44f1-80c7-6c3e86b6cb7d admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002663 Jun 15 14:35:44.997987 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 8/16] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 14:35:44 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:45.052828 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-d14f68d2-2094-4051-8a88-476609c5086c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "disk": 20, "id": "d4", "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:45.072081 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-d14f68d2-2094-4051-8a88-476609c5086c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072419 Jun 15 14:35:45.072734 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 9/17] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Jun 15 14:35:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:35:45.084772 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-825a1714-3a23-49ad-aeee-1f706c13c5aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:45.109388 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-825a1714-3a23-49ad-aeee-1f706c13c5aa admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028465 Jun 15 14:35:45.110042 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 9/18] 10.222.0.57 () {64 vars in 1335 bytes} [Wed Jun 15 14:35:45 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:35:47.311801 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-d14f68d2-2094-4051-8a88-476609c5086c admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:47.312808 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-d14f68d2-2094-4051-8a88-476609c5086c admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jun 15 14:35:47.313208 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 10/19] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 14:35:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:47.374242 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-cf736691-4a50-47d1-9b73-695b48a8d273 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:47.398915 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-cf736691-4a50-47d1-9b73-695b48a8d273 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079767 Jun 15 14:35:47.399450 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 10/20] 10.222.0.57 () {60 vars in 1291 bytes} [Wed Jun 15 14:35:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:35:49.589769 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-d14f68d2-2094-4051-8a88-476609c5086c admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:49.591255 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-d14f68d2-2094-4051-8a88-476609c5086c admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001626 Jun 15 14:35:49.591583 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 11/21] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 14:35:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:49.651845 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-8878505c-06a3-4f95-be48-274d2696c764 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "1", "disk": 1}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:49.669510 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-8878505c-06a3-4f95-be48-274d2696c764 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.071601 Jun 15 14:35:49.670084 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 11/22] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Jun 15 14:35:49 2022] POST /compute/v2.1/flavors => generated 402 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:35:49.682788 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-025e6045-249f-4398-b661-cb6009192cb6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:49.707558 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-025e6045-249f-4398-b661-cb6009192cb6 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028500 Jun 15 14:35:49.708138 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 12/23] 10.222.0.57 () {64 vars in 1332 bytes} [Wed Jun 15 14:35:49 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:35:51.899186 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-8878505c-06a3-4f95-be48-274d2696c764 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:51.900261 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-8878505c-06a3-4f95-be48-274d2696c764 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002785 Jun 15 14:35:51.900913 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 12/24] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 14:35:51 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:51.966353 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-c29f7448-4538-4738-ad22-0f8b234db13a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 20, "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "id": "2"}} {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:51.985085 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-c29f7448-4538-4738-ad22-0f8b234db13a admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077768 Jun 15 14:35:51.985734 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 13/25] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Jun 15 14:35:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:35:51.997961 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-d523f6d0-10d4-4da0-b834-c5b9c4f4a1b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:52.021047 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-d523f6d0-10d4-4da0-b834-c5b9c4f4a1b4 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026991 Jun 15 14:35:52.022174 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 13/26] 10.222.0.57 () {64 vars in 1332 bytes} [Wed Jun 15 14:35:51 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:35:54.192018 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-c29f7448-4538-4738-ad22-0f8b234db13a admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:54.193119 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-c29f7448-4538-4738-ad22-0f8b234db13a admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jun 15 14:35:54.193705 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 14/27] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 14:35:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:54.254750 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-2b3809e2-8d23-425b-964c-57e499be1394 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:54.277886 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-2b3809e2-8d23-425b-964c-57e499be1394 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.078442 Jun 15 14:35:54.278445 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 14/28] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Jun 15 14:35:54 2022] POST /compute/v2.1/flavors => generated 406 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:35:54.293413 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-bb7fb30d-2fcf-42c2-b79e-535094d13c2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:54.317198 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-bb7fb30d-2fcf-42c2-b79e-535094d13c2b admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027503 Jun 15 14:35:54.317824 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 15/29] 10.222.0.57 () {64 vars in 1332 bytes} [Wed Jun 15 14:35:54 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:35:56.518666 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-2b3809e2-8d23-425b-964c-57e499be1394 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:56.519657 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-2b3809e2-8d23-425b-964c-57e499be1394 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jun 15 14:35:56.520206 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 15/30] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 14:35:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:56.578769 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-c1d11b04-4e45-417f-9ec6-146bf19ac5d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 8192, "disk": 80, "name": "m1.large", "swap": 0, "id": "4"}} {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:56.597554 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-c1d11b04-4e45-417f-9ec6-146bf19ac5d9 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071267 Jun 15 14:35:56.598243 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 16/31] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Jun 15 14:35:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:35:56.610903 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-57edeefc-22e6-4b26-a00f-856c4bd8c8ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:56.633306 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-57edeefc-22e6-4b26-a00f-856c4bd8c8ec admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026034 Jun 15 14:35:56.634091 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 16/32] 10.222.0.57 () {64 vars in 1332 bytes} [Wed Jun 15 14:35:56 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:35:58.849411 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-c1d11b04-4e45-417f-9ec6-146bf19ac5d9 admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:35:58.850463 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-c1d11b04-4e45-417f-9ec6-146bf19ac5d9 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001634 Jun 15 14:35:58.850868 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 17/33] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 14:35:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:35:58.911836 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-f74be851-05c8-480f-ac47-0436b3b37d32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "disk": 160, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "vcpus": 8, "ram": 16384}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:58.930691 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-f74be851-05c8-480f-ac47-0436b3b37d32 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073964 Jun 15 14:35:58.931370 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 17/34] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Jun 15 14:35:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:35:58.943715 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-bd8d4580-5c01-401b-87be-38d7a71e9a3e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:35:58.966716 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-bd8d4580-5c01-401b-87be-38d7a71e9a3e admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027113 Jun 15 14:35:58.967322 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 18/35] 10.222.0.57 () {64 vars in 1332 bytes} [Wed Jun 15 14:35:58 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:36:23.914060 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-f74be851-05c8-480f-ac47-0436b3b37d32 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:23.915062 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-f74be851-05c8-480f-ac47-0436b3b37d32 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 15 14:36:23.915460 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 18/36] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 14:36:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:36:23.926589 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG dbcounter [-] [109791] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:36:23.974751 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-a8fccd6a-26eb-4c47-9f66-07c0e1637fa7 admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:23.992264 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-a8fccd6a-26eb-4c47-9f66-07c0e1637fa7 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070909 Jun 15 14:36:23.992793 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 19/37] 10.222.0.57 () {60 vars in 1291 bytes} [Wed Jun 15 14:36:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:36:24.957652 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-f74be851-05c8-480f-ac47-0436b3b37d32 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:24.958665 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-f74be851-05c8-480f-ac47-0436b3b37d32 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jun 15 14:36:24.959085 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 19/38] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Jun 15 14:36:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:36:25.165421 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-e426143e-f00a-499e-93db-5894299b7127 admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:25.171197 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.wsgi [None req-e426143e-f00a-499e-93db-5894299b7127 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 15 14:36:25.174571 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-e426143e-f00a-499e-93db-5894299b7127 admin admin] Request method failure captured: Jun 15 14:36:25.174571 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 15 14:36:25.174571 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: Accept: application/json Jun 15 14:36:25.174571 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: Accept-Encoding: gzip, deflate Jun 15 14:36:25.174571 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: Connection: keep-alive Jun 15 14:36:25.174571 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: Content-Length: 0 Jun 15 14:36:25.174571 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: Host: 10.222.0.57 Jun 15 14:36:25.174571 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: Openstack-Api-Version: compute 2.90 Jun 15 14:36:25.174571 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: Openstack-System-Scope: None Jun 15 14:36:25.174571 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: User-Agent: python-novaclient Jun 15 14:36:25.174571 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Auth-Token: gAAAAABiqe5ox6-N167HUh3TgEQwiJTwU_ZMaWECKrv94WzZmxX3jo59fNN0HsR8xIHtQRm8_lygqDDgwqoi--ICOdzaSCrOso5TnWTMu3jqp05udowEFrScrn9YekCWrpa80NDCibPM4FZ6AuuQaIEodbeVXGj0auU6uGZ213H9PUYxAjjaeOs Jun 15 14:36:25.174571 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Domain-Id: None Jun 15 14:36:25.174571 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Domain-Name: None Jun 15 14:36:25.174571 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Identity-Status: Confirmed Jun 15 14:36:25.174571 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Is-Admin-Project: True Jun 15 14:36:25.174571 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 14:36:25.174571 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Project-Domain-Id: default Jun 15 14:36:25.174571 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Project-Domain-Name: Default Jun 15 14:36:25.174571 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Project-Id: 10e451bce05f4f3c975f7e8a5cfb1440 Jun 15 14:36:25.174571 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Project-Name: admin Jun 15 14:36:25.174571 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Role: member,reader,admin Jun 15 14:36:25.174571 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Roles: member,reader,admin Jun 15 14:36:25.176512 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10e451bce05f4f3c975f7e8a5cfb1440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_10e451bce05f4f3c975f7e8a5cfb1440", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/10e451bce05f4f3c975f7e8a5cfb1440"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10e451bce05f4f3c975f7e8a5cfb1440"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:36:25.176512 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Tenant: admin Jun 15 14:36:25.176512 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Tenant-Id: 10e451bce05f4f3c975f7e8a5cfb1440 Jun 15 14:36:25.176512 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Tenant-Name: admin Jun 15 14:36:25.176512 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-User: admin Jun 15 14:36:25.176512 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-User-Domain-Id: default Jun 15 14:36:25.176512 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-User-Domain-Name: Default Jun 15 14:36:25.176512 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-User-Id: 1ec9e7f1acc8440b837c5cce9d23e7c5 Jun 15 14:36:25.176512 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-User-Name: admin Jun 15 14:36:25.176512 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: method: > Jun 15 14:36:25.176512 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: exception: Flavor 42 could not be found. Jun 15 14:36:25.176512 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: action_args: {'id': '42'} Jun 15 14:36:25.176512 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:36:25.176512 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:25.177487 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 14:36:25.177487 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 14:36:25.177487 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 14:36:25.177487 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 14:36:25.177487 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 14:36:25.177487 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 14:36:25.177487 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 14:36:25.177487 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 14:36:25.177487 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 14:36:25.177487 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:36:25.177487 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 14:36:25.177487 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 14:36:25.177487 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 15 14:36:25.177487 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi Jun 15 14:36:25.177487 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:36:25.177487 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi Jun 15 14:36:25.177487 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:25.177487 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:36:25.177487 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:36:25.178873 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:36:25.178873 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:36:25.178873 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:36:25.178873 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:36:25.178873 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 14:36:25.178873 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:36:25.178873 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 15 14:36:25.178873 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi Jun 15 14:36:25.178873 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:36:25.178873 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi Jun 15 14:36:25.178873 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:25.178873 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:36:25.178873 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:36:25.178873 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:36:25.178873 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:36:25.178873 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 15 14:36:25.178873 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi Jun 15 14:36:25.178873 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-e426143e-f00a-499e-93db-5894299b7127 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:36:25.180214 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-e426143e-f00a-499e-93db-5894299b7127 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062511 Jun 15 14:36:25.180214 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 20/39] 10.222.0.57 () {60 vars in 1190 bytes} [Wed Jun 15 14:36:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 14:36:25.185593 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-782c0fcc-eca5-44ed-a6a5-9b5204fc3ed1 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:25.188589 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:36:25.208519 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-782c0fcc-eca5-44ed-a6a5-9b5204fc3ed1 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026452 Jun 15 14:36:25.209073 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 20/40] 10.222.0.57 () {60 vars in 1210 bytes} [Wed Jun 15 14:36:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:36:25.218858 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-ff430212-067a-4fd6-b7ff-ab480ec00f0a admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:25.249418 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-ff430212-067a-4fd6-b7ff-ab480ec00f0a admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.033971 Jun 15 14:36:25.250028 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 21/41] 10.222.0.57 () {60 vars in 1210 bytes} [Wed Jun 15 14:36:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:36:25.259974 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-f6a83a72-630b-409d-8ec2-dc98d17881a5 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:25.266452 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.wsgi [None req-f6a83a72-630b-409d-8ec2-dc98d17881a5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 15 14:36:25.270442 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-f6a83a72-630b-409d-8ec2-dc98d17881a5 admin admin] Request method failure captured: Jun 15 14:36:25.270442 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 15 14:36:25.270442 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: Accept: application/json Jun 15 14:36:25.270442 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: Accept-Encoding: gzip, deflate Jun 15 14:36:25.270442 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: Connection: keep-alive Jun 15 14:36:25.270442 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: Content-Length: 0 Jun 15 14:36:25.270442 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: Host: 10.222.0.57 Jun 15 14:36:25.270442 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: Openstack-Api-Version: compute 2.90 Jun 15 14:36:25.270442 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: Openstack-System-Scope: None Jun 15 14:36:25.270442 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: User-Agent: python-novaclient Jun 15 14:36:25.270442 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Auth-Token: gAAAAABiqe5ox6-N167HUh3TgEQwiJTwU_ZMaWECKrv94WzZmxX3jo59fNN0HsR8xIHtQRm8_lygqDDgwqoi--ICOdzaSCrOso5TnWTMu3jqp05udowEFrScrn9YekCWrpa80NDCibPM4FZ6AuuQaIEodbeVXGj0auU6uGZ213H9PUYxAjjaeOs Jun 15 14:36:25.270442 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Domain-Id: None Jun 15 14:36:25.270442 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Domain-Name: None Jun 15 14:36:25.270442 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Identity-Status: Confirmed Jun 15 14:36:25.270442 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Is-Admin-Project: True Jun 15 14:36:25.270442 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 14:36:25.270442 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Project-Domain-Id: default Jun 15 14:36:25.270442 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Project-Domain-Name: Default Jun 15 14:36:25.270442 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Project-Id: 10e451bce05f4f3c975f7e8a5cfb1440 Jun 15 14:36:25.270442 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Project-Name: admin Jun 15 14:36:25.270442 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Role: member,reader,admin Jun 15 14:36:25.270442 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Roles: member,reader,admin Jun 15 14:36:25.271948 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10e451bce05f4f3c975f7e8a5cfb1440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_10e451bce05f4f3c975f7e8a5cfb1440", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/10e451bce05f4f3c975f7e8a5cfb1440"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10e451bce05f4f3c975f7e8a5cfb1440"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:36:25.271948 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Tenant: admin Jun 15 14:36:25.271948 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Tenant-Id: 10e451bce05f4f3c975f7e8a5cfb1440 Jun 15 14:36:25.271948 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Tenant-Name: admin Jun 15 14:36:25.271948 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-User: admin Jun 15 14:36:25.271948 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-User-Domain-Id: default Jun 15 14:36:25.271948 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-User-Domain-Name: Default Jun 15 14:36:25.271948 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-User-Id: 1ec9e7f1acc8440b837c5cce9d23e7c5 Jun 15 14:36:25.271948 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-User-Name: admin Jun 15 14:36:25.271948 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: method: > Jun 15 14:36:25.271948 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: exception: Flavor 42 could not be found. Jun 15 14:36:25.271948 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: action_args: {'id': '42'} Jun 15 14:36:25.271948 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:36:25.271948 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:25.272836 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 14:36:25.272836 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 14:36:25.272836 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 14:36:25.272836 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 14:36:25.272836 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 14:36:25.272836 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 14:36:25.272836 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 14:36:25.272836 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 14:36:25.272836 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 14:36:25.272836 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:36:25.272836 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 14:36:25.272836 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 14:36:25.272836 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 15 14:36:25.272836 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Jun 15 14:36:25.272836 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:36:25.272836 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Jun 15 14:36:25.272836 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:25.272836 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:36:25.272836 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:36:25.273913 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:36:25.273913 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:36:25.273913 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:36:25.273913 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:36:25.273913 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 14:36:25.273913 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:36:25.273913 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 15 14:36:25.273913 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Jun 15 14:36:25.273913 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:36:25.273913 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Jun 15 14:36:25.273913 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:25.273913 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:36:25.273913 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:36:25.273913 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:36:25.273913 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:36:25.273913 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 15 14:36:25.273913 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Jun 15 14:36:25.273913 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-f6a83a72-630b-409d-8ec2-dc98d17881a5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:36:25.274894 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-f6a83a72-630b-409d-8ec2-dc98d17881a5 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015432 Jun 15 14:36:25.274894 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 21/42] 10.222.0.57 () {60 vars in 1190 bytes} [Wed Jun 15 14:36:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 14:36:26.137839 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-ff430212-067a-4fd6-b7ff-ab480ec00f0a admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:26.138880 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-ff430212-067a-4fd6-b7ff-ab480ec00f0a admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jun 15 14:36:26.139305 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 22/43] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Jun 15 14:36:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:36:26.330534 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-bba495b4-6f64-497e-b342-94b90cb0ec38 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:26.335880 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.wsgi [None req-bba495b4-6f64-497e-b342-94b90cb0ec38 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 15 14:36:26.337369 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-bba495b4-6f64-497e-b342-94b90cb0ec38 admin admin] Request method failure captured: Jun 15 14:36:26.337369 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 15 14:36:26.337369 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: Accept: application/json Jun 15 14:36:26.337369 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: Accept-Encoding: gzip, deflate Jun 15 14:36:26.337369 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: Connection: keep-alive Jun 15 14:36:26.337369 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: Content-Length: 0 Jun 15 14:36:26.337369 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: Host: 10.222.0.57 Jun 15 14:36:26.337369 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: Openstack-Api-Version: compute 2.90 Jun 15 14:36:26.337369 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: Openstack-System-Scope: None Jun 15 14:36:26.337369 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: User-Agent: python-novaclient Jun 15 14:36:26.337369 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Auth-Token: gAAAAABiqe5q2ph4JPjhtIuaPTe0fBsCOFBCyXYVC2kdOs5j_NYONjvn-xs7fZIxS4j3GteblquQh0MIl8VENTFu9XXiMNT8gw_spESjlXBTu2PVo6yiWJ346Gnn_GYSOfVbgn1G4_CxKWxMtNXss97Knogppa1G95no9Nbxjwmk7o_kbNJxoq4 Jun 15 14:36:26.337369 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Domain-Id: None Jun 15 14:36:26.337369 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Domain-Name: None Jun 15 14:36:26.337369 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Identity-Status: Confirmed Jun 15 14:36:26.337369 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Is-Admin-Project: True Jun 15 14:36:26.337369 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 14:36:26.337369 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Project-Domain-Id: default Jun 15 14:36:26.337369 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Project-Domain-Name: Default Jun 15 14:36:26.337369 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Project-Id: 10e451bce05f4f3c975f7e8a5cfb1440 Jun 15 14:36:26.337369 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Project-Name: admin Jun 15 14:36:26.337369 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Role: member,reader,admin Jun 15 14:36:26.337369 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Roles: member,reader,admin Jun 15 14:36:26.339161 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10e451bce05f4f3c975f7e8a5cfb1440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_10e451bce05f4f3c975f7e8a5cfb1440", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/10e451bce05f4f3c975f7e8a5cfb1440"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10e451bce05f4f3c975f7e8a5cfb1440"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:36:26.339161 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Tenant: admin Jun 15 14:36:26.339161 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Tenant-Id: 10e451bce05f4f3c975f7e8a5cfb1440 Jun 15 14:36:26.339161 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Tenant-Name: admin Jun 15 14:36:26.339161 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-User: admin Jun 15 14:36:26.339161 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-User-Domain-Id: default Jun 15 14:36:26.339161 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-User-Domain-Name: Default Jun 15 14:36:26.339161 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-User-Id: 1ec9e7f1acc8440b837c5cce9d23e7c5 Jun 15 14:36:26.339161 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-User-Name: admin Jun 15 14:36:26.339161 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: method: > Jun 15 14:36:26.339161 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: exception: Flavor 84 could not be found. Jun 15 14:36:26.339161 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: action_args: {'id': '84'} Jun 15 14:36:26.339161 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:36:26.339161 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:26.340117 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 14:36:26.340117 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 14:36:26.340117 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 14:36:26.340117 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 14:36:26.340117 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 14:36:26.340117 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 14:36:26.340117 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 14:36:26.340117 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 14:36:26.340117 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 14:36:26.340117 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:36:26.340117 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 14:36:26.340117 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 14:36:26.340117 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 15 14:36:26.340117 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Jun 15 14:36:26.340117 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:36:26.340117 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Jun 15 14:36:26.340117 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:26.340117 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:36:26.340117 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:36:26.341361 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:36:26.341361 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:36:26.341361 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:36:26.341361 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:36:26.341361 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 14:36:26.341361 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:36:26.341361 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 15 14:36:26.341361 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Jun 15 14:36:26.341361 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:36:26.341361 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Jun 15 14:36:26.341361 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:26.341361 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:36:26.341361 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:36:26.341361 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:36:26.341361 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:36:26.341361 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 15 14:36:26.341361 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Jun 15 14:36:26.341361 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-bba495b4-6f64-497e-b342-94b90cb0ec38 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:36:26.342494 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-bba495b4-6f64-497e-b342-94b90cb0ec38 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061596 Jun 15 14:36:26.342494 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 22/44] 10.222.0.57 () {60 vars in 1190 bytes} [Wed Jun 15 14:36:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 14:36:26.349332 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-860f07a5-38bd-47f8-81f4-fc4da0bfdc27 admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:26.365319 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-860f07a5-38bd-47f8-81f4-fc4da0bfdc27 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020338 Jun 15 14:36:26.365879 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 23/45] 10.222.0.57 () {60 vars in 1210 bytes} [Wed Jun 15 14:36:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:36:26.375229 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-40c2aab2-9244-45f5-81b4-e00a7c9d5639 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:26.389018 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-40c2aab2-9244-45f5-81b4-e00a7c9d5639 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017252 Jun 15 14:36:26.389549 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 23/46] 10.222.0.57 () {60 vars in 1210 bytes} [Wed Jun 15 14:36:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:36:26.399795 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-a4e7ce0b-966b-4d4b-8e8c-5d43fdf5cccb admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:26.406471 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.wsgi [None req-a4e7ce0b-966b-4d4b-8e8c-5d43fdf5cccb admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 15 14:36:26.407994 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-a4e7ce0b-966b-4d4b-8e8c-5d43fdf5cccb admin admin] Request method failure captured: Jun 15 14:36:26.407994 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 15 14:36:26.407994 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: Accept: application/json Jun 15 14:36:26.407994 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: Accept-Encoding: gzip, deflate Jun 15 14:36:26.407994 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: Connection: keep-alive Jun 15 14:36:26.407994 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: Content-Length: 0 Jun 15 14:36:26.407994 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: Host: 10.222.0.57 Jun 15 14:36:26.407994 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: Openstack-Api-Version: compute 2.90 Jun 15 14:36:26.407994 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: Openstack-System-Scope: None Jun 15 14:36:26.407994 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: User-Agent: python-novaclient Jun 15 14:36:26.407994 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Auth-Token: gAAAAABiqe5q2ph4JPjhtIuaPTe0fBsCOFBCyXYVC2kdOs5j_NYONjvn-xs7fZIxS4j3GteblquQh0MIl8VENTFu9XXiMNT8gw_spESjlXBTu2PVo6yiWJ346Gnn_GYSOfVbgn1G4_CxKWxMtNXss97Knogppa1G95no9Nbxjwmk7o_kbNJxoq4 Jun 15 14:36:26.407994 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Domain-Id: None Jun 15 14:36:26.407994 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Domain-Name: None Jun 15 14:36:26.407994 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Identity-Status: Confirmed Jun 15 14:36:26.407994 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Is-Admin-Project: True Jun 15 14:36:26.407994 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 14:36:26.407994 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Project-Domain-Id: default Jun 15 14:36:26.407994 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Project-Domain-Name: Default Jun 15 14:36:26.407994 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Project-Id: 10e451bce05f4f3c975f7e8a5cfb1440 Jun 15 14:36:26.407994 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Project-Name: admin Jun 15 14:36:26.407994 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Role: member,reader,admin Jun 15 14:36:26.407994 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Roles: member,reader,admin Jun 15 14:36:26.410338 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10e451bce05f4f3c975f7e8a5cfb1440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_10e451bce05f4f3c975f7e8a5cfb1440", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/10e451bce05f4f3c975f7e8a5cfb1440"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10e451bce05f4f3c975f7e8a5cfb1440"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:36:26.410338 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Tenant: admin Jun 15 14:36:26.410338 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Tenant-Id: 10e451bce05f4f3c975f7e8a5cfb1440 Jun 15 14:36:26.410338 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Tenant-Name: admin Jun 15 14:36:26.410338 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-User: admin Jun 15 14:36:26.410338 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-User-Domain-Id: default Jun 15 14:36:26.410338 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-User-Domain-Name: Default Jun 15 14:36:26.410338 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-User-Id: 1ec9e7f1acc8440b837c5cce9d23e7c5 Jun 15 14:36:26.410338 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-User-Name: admin Jun 15 14:36:26.410338 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: method: > Jun 15 14:36:26.410338 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: exception: Flavor 84 could not be found. Jun 15 14:36:26.410338 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: action_args: {'id': '84'} Jun 15 14:36:26.410338 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:36:26.410338 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:26.411352 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 14:36:26.411352 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 14:36:26.411352 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 14:36:26.411352 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 14:36:26.411352 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 14:36:26.411352 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 14:36:26.411352 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 14:36:26.411352 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 14:36:26.411352 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 14:36:26.411352 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:36:26.411352 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 14:36:26.411352 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 14:36:26.411352 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 15 14:36:26.411352 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi Jun 15 14:36:26.411352 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:36:26.411352 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi Jun 15 14:36:26.411352 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:26.411352 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:36:26.411352 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:36:26.412881 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:36:26.412881 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:36:26.412881 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:36:26.412881 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:36:26.412881 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 14:36:26.412881 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:36:26.412881 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 15 14:36:26.412881 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi Jun 15 14:36:26.412881 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:36:26.412881 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi Jun 15 14:36:26.412881 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:26.412881 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:36:26.412881 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:36:26.412881 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:36:26.412881 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:36:26.412881 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 15 14:36:26.412881 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi Jun 15 14:36:26.412881 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-a4e7ce0b-966b-4d4b-8e8c-5d43fdf5cccb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:36:26.414208 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-a4e7ce0b-966b-4d4b-8e8c-5d43fdf5cccb admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.014488 Jun 15 14:36:26.414208 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 24/47] 10.222.0.57 () {60 vars in 1190 bytes} [Wed Jun 15 14:36:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 14:36:27.282445 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-40c2aab2-9244-45f5-81b4-e00a7c9d5639 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:27.283478 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-40c2aab2-9244-45f5-81b4-e00a7c9d5639 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 15 14:36:27.283875 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 24/48] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Jun 15 14:36:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:36:27.476081 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-89c5ff9c-e29e-4158-be31-cb321630694a admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:27.481780 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.wsgi [None req-89c5ff9c-e29e-4158-be31-cb321630694a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 15 14:36:27.483271 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-89c5ff9c-e29e-4158-be31-cb321630694a admin admin] Request method failure captured: Jun 15 14:36:27.483271 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 15 14:36:27.483271 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: Accept: application/json Jun 15 14:36:27.483271 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: Accept-Encoding: gzip, deflate Jun 15 14:36:27.483271 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: Connection: keep-alive Jun 15 14:36:27.483271 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: Content-Length: 0 Jun 15 14:36:27.483271 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: Host: 10.222.0.57 Jun 15 14:36:27.483271 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: Openstack-Api-Version: compute 2.90 Jun 15 14:36:27.483271 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: Openstack-System-Scope: None Jun 15 14:36:27.483271 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: User-Agent: python-novaclient Jun 15 14:36:27.483271 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Auth-Token: gAAAAABiqe5r_egDipQ4Onj-ifzEJZQJpP_DTQSoLztS-NMlQHD3Un-MgLmqWO3Z8v_MBBEsd88mgQxh3tcHKBW1MWLT1929QGjbrMoiZ5OA2Z_tcHN7m5urzzH0nwUFTrzaXf2PZ02MLKK4TvGeK69YOY6bK3RBvQYwpIfkwjJNIkCFWm3-iE0 Jun 15 14:36:27.483271 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Domain-Id: None Jun 15 14:36:27.483271 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Domain-Name: None Jun 15 14:36:27.483271 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Identity-Status: Confirmed Jun 15 14:36:27.483271 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Is-Admin-Project: True Jun 15 14:36:27.483271 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 14:36:27.483271 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Project-Domain-Id: default Jun 15 14:36:27.483271 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Project-Domain-Name: Default Jun 15 14:36:27.483271 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Project-Id: 10e451bce05f4f3c975f7e8a5cfb1440 Jun 15 14:36:27.483271 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Project-Name: admin Jun 15 14:36:27.483271 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Role: member,reader,admin Jun 15 14:36:27.483271 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Roles: member,reader,admin Jun 15 14:36:27.484826 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10e451bce05f4f3c975f7e8a5cfb1440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_10e451bce05f4f3c975f7e8a5cfb1440", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/10e451bce05f4f3c975f7e8a5cfb1440"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10e451bce05f4f3c975f7e8a5cfb1440"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:36:27.484826 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Tenant: admin Jun 15 14:36:27.484826 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Tenant-Id: 10e451bce05f4f3c975f7e8a5cfb1440 Jun 15 14:36:27.484826 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-Tenant-Name: admin Jun 15 14:36:27.484826 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-User: admin Jun 15 14:36:27.484826 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-User-Domain-Id: default Jun 15 14:36:27.484826 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-User-Domain-Name: Default Jun 15 14:36:27.484826 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-User-Id: 1ec9e7f1acc8440b837c5cce9d23e7c5 Jun 15 14:36:27.484826 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: X-User-Name: admin Jun 15 14:36:27.484826 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: method: > Jun 15 14:36:27.484826 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: exception: Flavor 451 could not be found. Jun 15 14:36:27.484826 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: action_args: {'id': '451'} Jun 15 14:36:27.484826 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:36:27.484826 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:27.485959 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 14:36:27.485959 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 14:36:27.485959 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 14:36:27.485959 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 14:36:27.485959 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 14:36:27.485959 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 14:36:27.485959 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 14:36:27.485959 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 14:36:27.485959 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 14:36:27.485959 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:36:27.485959 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 14:36:27.485959 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 14:36:27.485959 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 15 14:36:27.485959 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi Jun 15 14:36:27.485959 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:36:27.485959 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi Jun 15 14:36:27.485959 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:27.485959 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:36:27.485959 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:36:27.488045 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:36:27.488045 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:36:27.488045 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:36:27.488045 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:36:27.488045 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 14:36:27.488045 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:36:27.488045 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 15 14:36:27.488045 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi Jun 15 14:36:27.488045 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:36:27.488045 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi Jun 15 14:36:27.488045 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:27.488045 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:36:27.488045 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:36:27.488045 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:36:27.488045 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:36:27.488045 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 15 14:36:27.488045 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: ERROR nova.api.openstack.wsgi Jun 15 14:36:27.488045 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-89c5ff9c-e29e-4158-be31-cb321630694a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:36:27.489351 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-89c5ff9c-e29e-4158-be31-cb321630694a admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062027 Jun 15 14:36:27.489351 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 25/49] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Jun 15 14:36:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 14:36:27.494701 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-e5e4aee7-6e17-4582-a989-86f7d3cf41fc admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:27.508813 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-e5e4aee7-6e17-4582-a989-86f7d3cf41fc admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017714 Jun 15 14:36:27.509337 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 25/50] 10.222.0.57 () {60 vars in 1210 bytes} [Wed Jun 15 14:36:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:36:27.518681 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-29fa11fb-bc43-4e60-9d27-554c167acedd admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:27.532066 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-29fa11fb-bc43-4e60-9d27-554c167acedd admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017037 Jun 15 14:36:27.532584 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 26/51] 10.222.0.57 () {60 vars in 1210 bytes} [Wed Jun 15 14:36:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:36:27.541938 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-f485a30e-704e-4fa5-9687-3f6b0c1c850c admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:27.547130 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.wsgi [None req-f485a30e-704e-4fa5-9687-3f6b0c1c850c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 15 14:36:27.548615 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-f485a30e-704e-4fa5-9687-3f6b0c1c850c admin admin] Request method failure captured: Jun 15 14:36:27.548615 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 15 14:36:27.548615 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: Accept: application/json Jun 15 14:36:27.548615 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: Accept-Encoding: gzip, deflate Jun 15 14:36:27.548615 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: Connection: keep-alive Jun 15 14:36:27.548615 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: Content-Length: 0 Jun 15 14:36:27.548615 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: Host: 10.222.0.57 Jun 15 14:36:27.548615 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: Openstack-Api-Version: compute 2.90 Jun 15 14:36:27.548615 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: Openstack-System-Scope: None Jun 15 14:36:27.548615 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: User-Agent: python-novaclient Jun 15 14:36:27.548615 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Auth-Token: gAAAAABiqe5r_egDipQ4Onj-ifzEJZQJpP_DTQSoLztS-NMlQHD3Un-MgLmqWO3Z8v_MBBEsd88mgQxh3tcHKBW1MWLT1929QGjbrMoiZ5OA2Z_tcHN7m5urzzH0nwUFTrzaXf2PZ02MLKK4TvGeK69YOY6bK3RBvQYwpIfkwjJNIkCFWm3-iE0 Jun 15 14:36:27.548615 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Domain-Id: None Jun 15 14:36:27.548615 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Domain-Name: None Jun 15 14:36:27.548615 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Identity-Status: Confirmed Jun 15 14:36:27.548615 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Is-Admin-Project: True Jun 15 14:36:27.548615 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 14:36:27.548615 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Project-Domain-Id: default Jun 15 14:36:27.548615 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Project-Domain-Name: Default Jun 15 14:36:27.548615 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Project-Id: 10e451bce05f4f3c975f7e8a5cfb1440 Jun 15 14:36:27.548615 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Project-Name: admin Jun 15 14:36:27.548615 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Role: member,reader,admin Jun 15 14:36:27.548615 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Roles: member,reader,admin Jun 15 14:36:27.550773 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10e451bce05f4f3c975f7e8a5cfb1440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_10e451bce05f4f3c975f7e8a5cfb1440", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/10e451bce05f4f3c975f7e8a5cfb1440"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/10e451bce05f4f3c975f7e8a5cfb1440"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:36:27.550773 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Tenant: admin Jun 15 14:36:27.550773 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Tenant-Id: 10e451bce05f4f3c975f7e8a5cfb1440 Jun 15 14:36:27.550773 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-Tenant-Name: admin Jun 15 14:36:27.550773 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-User: admin Jun 15 14:36:27.550773 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-User-Domain-Id: default Jun 15 14:36:27.550773 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-User-Domain-Name: Default Jun 15 14:36:27.550773 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-User-Id: 1ec9e7f1acc8440b837c5cce9d23e7c5 Jun 15 14:36:27.550773 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: X-User-Name: admin Jun 15 14:36:27.550773 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: method: > Jun 15 14:36:27.550773 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: exception: Flavor 451 could not be found. Jun 15 14:36:27.550773 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: action_args: {'id': '451'} Jun 15 14:36:27.550773 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:36:27.550773 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:27.551884 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 14:36:27.551884 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 14:36:27.551884 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 14:36:27.551884 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 14:36:27.551884 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 14:36:27.551884 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 14:36:27.551884 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 14:36:27.551884 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 14:36:27.551884 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 14:36:27.551884 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:36:27.551884 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 14:36:27.551884 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 14:36:27.551884 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 15 14:36:27.551884 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Jun 15 14:36:27.551884 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:36:27.551884 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Jun 15 14:36:27.551884 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:27.551884 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:36:27.551884 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:36:27.553279 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:36:27.553279 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:36:27.553279 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:36:27.553279 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:36:27.553279 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 14:36:27.553279 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:36:27.553279 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 15 14:36:27.553279 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Jun 15 14:36:27.553279 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:36:27.553279 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Jun 15 14:36:27.553279 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:36:27.553279 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:36:27.553279 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:36:27.553279 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:36:27.553279 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:36:27.553279 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 15 14:36:27.553279 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: ERROR nova.api.openstack.wsgi Jun 15 14:36:27.553279 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-f485a30e-704e-4fa5-9687-3f6b0c1c850c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:36:27.554814 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-f485a30e-704e-4fa5-9687-3f6b0c1c850c admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012095 Jun 15 14:36:27.554814 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 26/52] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Jun 15 14:36:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 14:36:28.419027 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-29fa11fb-bc43-4e60-9d27-554c167acedd admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:28.420026 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-29fa11fb-bc43-4e60-9d27-554c167acedd admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jun 15 14:36:28.420418 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 27/53] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Jun 15 14:36:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:36:28.613268 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-68ba5184-e259-4259-9113-5df9e52a37b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:36:28.632647 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-68ba5184-e259-4259-9113-5df9e52a37b9 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.071736 Jun 15 14:36:28.633114 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 27/54] 10.222.0.57 () {64 vars in 1235 bytes} [Wed Jun 15 14:36:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:36:29.503151 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-29fa11fb-bc43-4e60-9d27-554c167acedd admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:29.504141 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-29fa11fb-bc43-4e60-9d27-554c167acedd admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jun 15 14:36:29.504538 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 28/55] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Jun 15 14:36:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:36:29.696806 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-09fb2ecf-2d4e-4139-9b10-6ad54423932d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:36:29.715248 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-09fb2ecf-2d4e-4139-9b10-6ad54423932d admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069517 Jun 15 14:36:29.715804 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 28/56] 10.222.0.57 () {64 vars in 1235 bytes} [Wed Jun 15 14:36:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:36:30.588526 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-29fa11fb-bc43-4e60-9d27-554c167acedd admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:30.589529 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-29fa11fb-bc43-4e60-9d27-554c167acedd admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001656 Jun 15 14:36:30.589970 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 29/57] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Jun 15 14:36:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:36:30.779346 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-9aa6440f-6713-4418-8ba1-9a62b9dd1577 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:36:30.795965 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-9aa6440f-6713-4418-8ba1-9a62b9dd1577 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068774 Jun 15 14:36:30.796479 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 29/58] 10.222.0.57 () {64 vars in 1235 bytes} [Wed Jun 15 14:36:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:36:31.675015 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-29fa11fb-bc43-4e60-9d27-554c167acedd admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:31.676008 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-29fa11fb-bc43-4e60-9d27-554c167acedd admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 15 14:36:31.676398 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 30/59] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Jun 15 14:36:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:36:31.870490 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-3f09b93f-dc5f-4ac9-9a9c-2053a227ebf9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:36:31.888419 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-3f09b93f-dc5f-4ac9-9a9c-2053a227ebf9 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068755 Jun 15 14:36:31.888894 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 30/60] 10.222.0.57 () {64 vars in 1235 bytes} [Wed Jun 15 14:36:31 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:36:32.771529 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-29fa11fb-bc43-4e60-9d27-554c167acedd admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:32.772524 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-29fa11fb-bc43-4e60-9d27-554c167acedd admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 Jun 15 14:36:32.772919 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 31/61] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Jun 15 14:36:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:36:32.964873 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-6cc359a1-3c9b-4a27-8ec0-89ffd8e5c7fd admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:36:32.984610 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-6cc359a1-3c9b-4a27-8ec0-89ffd8e5c7fd admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072213 Jun 15 14:36:32.985087 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 31/62] 10.222.0.57 () {60 vars in 1202 bytes} [Wed Jun 15 14:36:32 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:37:21.365381 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-29fa11fb-bc43-4e60-9d27-554c167acedd admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:37:21.366416 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-29fa11fb-bc43-4e60-9d27-554c167acedd admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 15 14:37:21.366815 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 32/63] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 14:37:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:37:21.378185 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:21.426793 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-4fec7c68-b788-46b8-9606-a4d62e0bb1f6 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:37:21.446469 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-4fec7c68-b788-46b8-9606-a4d62e0bb1f6 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073740 Jun 15 14:37:21.447009 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 32/64] 10.222.0.57 () {60 vars in 1291 bytes} [Wed Jun 15 14:37:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:37:21.470893 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-e0102d70-aba2-4bac-9b78-98ebc809e1d6 admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:37:21.474315 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG dbcounter [-] [109791] Writing DB stats nova_api:SELECT=14 {{(pid=109791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:37:21.480029 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-e0102d70-aba2-4bac-9b78-98ebc809e1d6 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013505 Jun 15 14:37:21.480562 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 33/65] 10.222.0.57 () {60 vars in 1282 bytes} [Wed Jun 15 14:37:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:37:21.492824 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-aba74064-c492-47ef-83ce-cfd3df097af2 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:37:21.500499 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-aba74064-c492-47ef-83ce-cfd3df097af2 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011264 Jun 15 14:37:21.501006 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 33/66] 10.222.0.57 () {60 vars in 1285 bytes} [Wed Jun 15 14:37:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:37:21.512200 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-2b1f2134-e7b1-4d76-a820-6cf530e2ddc9 admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:37:21.519894 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-2b1f2134-e7b1-4d76-a820-6cf530e2ddc9 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011262 Jun 15 14:37:21.520408 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 34/67] 10.222.0.57 () {60 vars in 1285 bytes} [Wed Jun 15 14:37:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:37:21.531718 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-a050cb88-6159-4354-8382-8f4f23113335 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:37:21.539169 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-a050cb88-6159-4354-8382-8f4f23113335 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011371 Jun 15 14:37:21.539677 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 34/68] 10.222.0.57 () {60 vars in 1282 bytes} [Wed Jun 15 14:37:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:40:44.055808 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-2b1f2134-e7b1-4d76-a820-6cf530e2ddc9 admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:40:44.056854 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-2b1f2134-e7b1-4d76-a820-6cf530e2ddc9 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jun 15 14:40:44.057248 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 35/69] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Jun 15 14:40:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:40:44.216855 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writing DB stats nova_api:SELECT=6 {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:40:44.334378 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-4b5ddea3-2a30-4174-96ad-1e4cbbec70e3 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:40:44.335588 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:40:44.335588 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: warnings.warn(msg) Jun 15 14:40:44.336770 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-4b5ddea3-2a30-4174-96ad-1e4cbbec70e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:40:44.337206 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-4b5ddea3-2a30-4174-96ad-1e4cbbec70e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:40:44.338015 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-4b5ddea3-2a30-4174-96ad-1e4cbbec70e3 admin admin] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:40:44.338438 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-4b5ddea3-2a30-4174-96ad-1e4cbbec70e3 admin admin] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:40:44.373816 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-4b5ddea3-2a30-4174-96ad-1e4cbbec70e3 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.158897 Jun 15 14:40:44.374371 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 35/70] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Jun 15 14:40:44 2022] GET /compute/v2.1/os-services => generated 791 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:40:45.248466 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-2b1f2134-e7b1-4d76-a820-6cf530e2ddc9 admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:40:45.249466 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-2b1f2134-e7b1-4d76-a820-6cf530e2ddc9 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jun 15 14:40:45.249898 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 36/71] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Jun 15 14:40:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:40:45.447101 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-8cc9ea51-0db2-4778-8389-49de077fc123 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:40:45.448275 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:40:45.448275 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: warnings.warn(msg) Jun 15 14:40:45.449478 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-8cc9ea51-0db2-4778-8389-49de077fc123 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:40:45.449995 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-8cc9ea51-0db2-4778-8389-49de077fc123 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:40:45.450792 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-8cc9ea51-0db2-4778-8389-49de077fc123 admin admin] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:40:45.451224 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-8cc9ea51-0db2-4778-8389-49de077fc123 admin admin] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:40:45.470773 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-8cc9ea51-0db2-4778-8389-49de077fc123 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075665 Jun 15 14:40:45.471275 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 36/72] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Jun 15 14:40:45 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:40:56.743029 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-2b1f2134-e7b1-4d76-a820-6cf530e2ddc9 admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:40:56.744047 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-2b1f2134-e7b1-4d76-a820-6cf530e2ddc9 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 Jun 15 14:40:56.744436 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 37/73] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Jun 15 14:40:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:40:56.889736 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writing DB stats nova_cell0:SELECT=4 {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:40:56.890478 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writing DB stats nova_cell1:SELECT=4 {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:40:56.891187 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writing DB stats nova_api:SELECT=8 {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:40:56.940169 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-4b7f3f13-d801-4d02-9db3-1e83e5a31326 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:40:56.941331 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:40:56.941331 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: warnings.warn(msg) Jun 15 14:40:56.942546 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-4b7f3f13-d801-4d02-9db3-1e83e5a31326 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:40:56.942991 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-4b7f3f13-d801-4d02-9db3-1e83e5a31326 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:40:56.943777 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-4b7f3f13-d801-4d02-9db3-1e83e5a31326 admin admin] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:40:56.944207 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-4b7f3f13-d801-4d02-9db3-1e83e5a31326 admin admin] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:40:56.963595 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-4b7f3f13-d801-4d02-9db3-1e83e5a31326 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078336 Jun 15 14:40:56.964078 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 37/74] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Jun 15 14:40:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:40:57.852591 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-2b1f2134-e7b1-4d76-a820-6cf530e2ddc9 admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:40:57.853612 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-2b1f2134-e7b1-4d76-a820-6cf530e2ddc9 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jun 15 14:40:57.854077 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 38/75] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Jun 15 14:40:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:40:58.045969 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-12267bb7-2a2f-49f8-8e07-c9dc09362a3b admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:40:58.047139 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:40:58.047139 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: warnings.warn(msg) Jun 15 14:40:58.048318 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-12267bb7-2a2f-49f8-8e07-c9dc09362a3b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:40:58.048768 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-12267bb7-2a2f-49f8-8e07-c9dc09362a3b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:40:58.049561 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-12267bb7-2a2f-49f8-8e07-c9dc09362a3b admin admin] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:40:58.050017 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-12267bb7-2a2f-49f8-8e07-c9dc09362a3b admin admin] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:40:58.071906 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-12267bb7-2a2f-49f8-8e07-c9dc09362a3b admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078844 Jun 15 14:40:58.072398 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 38/76] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Jun 15 14:40:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:41:09.368482 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-2b1f2134-e7b1-4d76-a820-6cf530e2ddc9 admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:41:09.369480 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-2b1f2134-e7b1-4d76-a820-6cf530e2ddc9 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Jun 15 14:41:09.369905 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 39/77] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Jun 15 14:41:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:41:09.519667 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writing DB stats nova_cell0:SELECT=4 {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:41:09.520317 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writing DB stats nova_cell1:SELECT=4 {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:41:09.521205 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG dbcounter [-] [109792] Writing DB stats nova_api:SELECT=8 {{(pid=109792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:41:09.573354 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-d0169d80-ae28-4ee4-924c-3b7c1cba02b2 admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:41:09.574619 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:41:09.574619 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: warnings.warn(msg) Jun 15 14:41:09.576132 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-d0169d80-ae28-4ee4-924c-3b7c1cba02b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:41:09.576575 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-d0169d80-ae28-4ee4-924c-3b7c1cba02b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:41:09.577361 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-d0169d80-ae28-4ee4-924c-3b7c1cba02b2 admin admin] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:41:09.577830 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-d0169d80-ae28-4ee4-924c-3b7c1cba02b2 admin admin] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:41:09.602767 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-d0169d80-ae28-4ee4-924c-3b7c1cba02b2 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087529 Jun 15 14:41:09.603313 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 39/78] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Jun 15 14:41:09 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:41:10.475278 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: DEBUG nova.api.openstack.wsgi [None req-2b1f2134-e7b1-4d76-a820-6cf530e2ddc9 admin admin] Calling method '>' {{(pid=109791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:41:10.476283 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: INFO nova.api.openstack.requestlog [None req-2b1f2134-e7b1-4d76-a820-6cf530e2ddc9 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Jun 15 14:41:10.476682 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: [pid: 109791|app: 0|req: 40/79] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Jun 15 14:41:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:41:10.669595 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG nova.api.openstack.wsgi [None req-938a1065-cc1f-46c3-8119-afcf4b50194f admin admin] Calling method '>' {{(pid=109792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:41:10.670841 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:41:10.670841 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: warnings.warn(msg) Jun 15 14:41:10.672033 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-938a1065-cc1f-46c3-8119-afcf4b50194f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:41:10.672465 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-938a1065-cc1f-46c3-8119-afcf4b50194f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:41:10.673258 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-938a1065-cc1f-46c3-8119-afcf4b50194f admin admin] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:41:10.673725 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: DEBUG oslo_concurrency.lockutils [None req-938a1065-cc1f-46c3-8119-afcf4b50194f admin admin] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:41:10.695552 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: INFO nova.api.openstack.requestlog [None req-938a1065-cc1f-46c3-8119-afcf4b50194f admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077895 Jun 15 14:41:10.696309 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: [pid: 109792|app: 0|req: 40/80] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Jun 15 14:41:10 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:42:14.016960 dv-cinder-843277-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 15 14:42:14.017539 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: Wed Jun 15 14:42:14 2022 - graceful shutdown triggered... Jun 15 14:42:14.018044 dv-cinder-843277-3-iscsi devstack@n-api.service[109792]: Gracefully killing worker 2 (pid: 109792)... Jun 15 14:42:14.018473 dv-cinder-843277-3-iscsi devstack@n-api.service[109791]: Gracefully killing worker 1 (pid: 109791)... Jun 15 14:42:15.018667 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: worker 1 buried after 1 seconds Jun 15 14:42:15.018667 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: worker 2 buried after 1 seconds Jun 15 14:42:15.019302 dv-cinder-843277-3-iscsi devstack@n-api.service[109790]: goodbye to uWSGI. Jun 15 14:42:15.020233 dv-cinder-843277-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 15 14:42:15.020775 dv-cinder-843277-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 15 14:42:15.023502 dv-cinder-843277-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 15 14:42:15.042561 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 15 14:42:15.045927 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 14:42:15 2022] *** Jun 15 14:42:15.045927 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 14:42:15.045927 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 14:42:15.045927 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: nodename: dv-cinder-843277-3-iscsi Jun 15 14:42:15.045927 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: machine: x86_64 Jun 15 14:42:15.045927 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: clock source: unix Jun 15 14:42:15.045927 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: pcre jit disabled Jun 15 14:42:15.045927 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: detected number of CPU cores: 4 Jun 15 14:42:15.045927 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: current working directory: / Jun 15 14:42:15.045927 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: detected binary path: /usr/bin/uwsgi-core Jun 15 14:42:15.045927 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: your processes number limit is 47680 Jun 15 14:42:15.045927 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: your memory page size is 4096 bytes Jun 15 14:42:15.046728 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: detected max file descriptor number: 2048 Jun 15 14:42:15.046728 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: lock engine: pthread robust mutexes Jun 15 14:42:15.046728 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: thunder lock: enabled Jun 15 14:42:15.046728 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 15 14:42:15.046728 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 14:42:15.093899 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: Python main interpreter initialized at 0x559df25ad9c0 Jun 15 14:42:15.093899 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: python threads support enabled Jun 15 14:42:15.093899 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: your server socket listen backlog is limited to 100 connections Jun 15 14:42:15.093899 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: your mercy for graceful operations on workers is 90 seconds Jun 15 14:42:15.094408 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 14:42:15.094408 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: *** Operational MODE: preforking *** Jun 15 14:42:15.094617 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: *** uWSGI is running in multiple interpreter mode *** Jun 15 14:42:15.094707 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: spawned uWSGI master process (pid: 124198) Jun 15 14:42:15.094850 dv-cinder-843277-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 15 14:42:15.095701 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: spawned uWSGI worker 1 (pid: 124219, cores: 1) Jun 15 14:42:15.096062 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: spawned uWSGI worker 2 (pid: 124220, cores: 1) Jun 15 14:42:15.099562 dv-cinder-843277-3-iscsi devstack@n-api.service[124198]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 14:42:15.761471 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 14:42:15.775477 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 14:42:17.027163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:42:17.027163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: from cryptography.utils import int_from_bytes Jun 15 14:42:17.027809 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:42:17.027809 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: from cryptography.utils import int_from_bytes Jun 15 14:42:17.054350 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:42:17.054350 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: from cryptography.utils import int_from_bytes Jun 15 14:42:17.054350 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:42:17.054350 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: from cryptography.utils import int_from_bytes Jun 15 14:42:19.484923 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 14:42:19.485463 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 14:42:19.485738 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 14:42:19.486109 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 14:42:19.486375 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 14:42:19.486770 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.487103 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.487429 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.487751 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.488085 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.488401 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.488727 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.489047 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.489379 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.489643 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.489992 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.490323 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843277-3-iscsi {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.490653 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.490964 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.491280 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.491605 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.491913 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.492238 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.492548 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.493052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.493490 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.493832 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.494149 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.496465 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.496465 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.496465 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.496465 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.496465 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.496465 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.496465 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.497013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843277-3-iscsi {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.497013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.497343 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.497718 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.498648 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.498967 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.499288 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.499611 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.499938 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.500252 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.500598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.500923 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.501246 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.501572 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.501903 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.502217 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.502531 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.502898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.503171 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.503882 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.503882 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.504066 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.504331 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.505035 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.505035 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.510285 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.510285 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.510285 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.510285 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.510285 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.510285 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.510285 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.511329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.511329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.511329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.511329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.511329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.511329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.511329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.511329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.511960 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.511960 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.511960 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.511960 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.511960 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.511960 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.511960 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.511960 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.512572 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.512572 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.512840 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.513150 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.513462 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.514371 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.514975 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.515305 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.515566 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.515876 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.516190 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.516516 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.516830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.517142 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.517452 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.517781 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.518110 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.518410 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.518718 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.519031 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.519342 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.519653 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.519963 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.520272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.520581 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.520905 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.521229 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.521538 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.521874 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.522185 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.522493 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.522823 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.523133 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.523441 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.523766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.524076 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.524385 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.524707 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.525019 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.525329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.525651 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.525975 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.526282 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.526605 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.526917 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.527226 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.527533 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.527841 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.528149 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.528454 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.528758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.529067 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.529464 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.530188 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.530188 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.530492 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.530740 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.531049 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.531373 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.531715 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.532052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.532426 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.532750 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.533091 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.533428 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.533776 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.534096 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.534414 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.534748 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.535065 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.535379 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.535694 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.536015 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.536336 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.536672 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.536989 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.537309 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.537632 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.537970 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.538294 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.538626 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.538951 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.539265 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.539612 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.539963 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.540283 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.540615 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.540944 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.541259 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.541577 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.541921 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.542253 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.542599 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.542919 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.543243 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.543561 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.543877 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.544192 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.544507 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.544843 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.545194 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.545553 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.545897 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.546217 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.546541 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.546859 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.547175 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.547492 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.547802 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.548113 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.548425 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.548740 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.549047 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.549372 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.549726 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.550042 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.550381 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.550693 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.551008 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.551323 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.551638 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.551740 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 14:42:19.552150 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 14:42:19.552290 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.552290 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.552473 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 14:42:19.552564 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.552773 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 14:42:19.552876 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.553030 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 14:42:19.553173 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.553418 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.553516 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.553772 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.553868 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.554103 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.554203 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.554421 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.554516 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.554728 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.554820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.555047 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.555140 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.555362 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.555455 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.555676 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.555781 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.555990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.556095 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.556249 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.556361 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.556565 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.556734 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.556889 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843277-3-iscsi {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.556983 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.557211 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.557314 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.557518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.557623 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.557854 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.557948 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.558173 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.558272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.558480 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.558598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.558801 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.558912 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.559104 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.559204 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.559479 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.559602 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.559794 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.559913 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.560103 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.560215 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.560413 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.561088 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.561332 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.561651 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.561980 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.562091 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.562288 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.562387 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.562603 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.562696 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.562914 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.563021 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.563223 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.563316 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.563550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.563648 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.563861 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.563968 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.564170 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.564271 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843277-3-iscsi {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.564480 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.564578 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.564787 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.564888 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.565134 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.565227 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.565446 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.565546 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.565821 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.565928 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.566162 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.566255 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.566486 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.566591 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.566807 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.566906 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.567116 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.567208 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.567432 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.567533 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.567748 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.567848 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.568064 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.568164 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.568380 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.568500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.568682 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.568784 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.568990 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.569102 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.569296 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.569396 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.569613 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.569735 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.569944 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.570050 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.570248 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.570354 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.570499 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.570600 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.570805 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.570898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.571127 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.571237 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.571447 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.571540 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.571767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.571862 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.572019 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.572124 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.572270 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.572443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.572589 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.572776 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.572909 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.573092 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.573217 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.573410 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.573523 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.573744 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.573858 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.574063 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.574162 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.574377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.574477 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.574690 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.574791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.575013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.575106 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.575320 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.575419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.575637 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.575738 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.575948 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.576039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.576935 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.577051 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.577285 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.577586 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.577709 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.577942 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.578046 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.578262 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.578364 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.578588 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.578702 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.578902 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.579028 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.579223 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.579341 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.579538 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.579690 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.579855 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.579953 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.580167 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.580279 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.580482 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.580618 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.580790 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.580881 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.581099 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.581200 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.581408 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.581509 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.581746 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.581843 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.582070 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.582165 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.582374 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.582465 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.582630 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.582734 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.582932 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.583026 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.583238 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.583336 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.583814 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.583914 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.584135 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.584229 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.584440 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.584533 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.584745 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.584845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.585046 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.585141 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.585350 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.585444 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.585654 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.585811 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.585985 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.586077 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.586291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.586383 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.586597 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.586703 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.586900 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.587000 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.587204 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.587304 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.587507 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.587609 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.587810 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.587918 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.588116 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.588207 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.588439 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.588539 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.588745 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.588845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.589053 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.589156 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.589384 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.589480 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.589632 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.589784 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.589975 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.590069 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.590282 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.590389 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.590589 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.590691 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.590910 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.591009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.591213 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.591312 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.591515 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.591622 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.591937 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.592042 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.592258 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.592580 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.592716 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.592898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.592992 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.593214 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.593307 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.593545 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.593637 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.593885 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.593990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.594199 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.594291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.594512 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.594617 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.594819 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.594917 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.595122 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.595214 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.595426 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.595533 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.595732 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.596000 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.596094 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.596327 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.596419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.596631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.596731 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.596931 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.597030 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.597251 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.597388 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.597573 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.597716 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.597907 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.598026 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.598214 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.598320 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.598519 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.598612 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.598838 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:42:19.598946 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.599177 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.599282 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.599487 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.599590 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.599777 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.599921 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.600090 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.600185 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.600400 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.600492 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.600709 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.600803 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.601018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.601155 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.601331 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.601424 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.601640 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.601818 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.601969 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.602091 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.602277 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.602372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.602592 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.602693 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.602903 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.603002 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.603209 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.603310 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.603525 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.603618 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.603833 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.603933 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.604158 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.604258 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.604470 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.604569 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.604779 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.604873 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.605088 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.605189 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.605394 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.605492 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.605749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.605859 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.606063 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.606168 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.606371 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.606463 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.606713 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.606813 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.607057 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.607151 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.607392 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.607487 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.607706 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.608039 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.608176 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.608349 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.608511 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.608660 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.608834 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.608968 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.609153 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.609379 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.609530 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.609631 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.609866 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.610006 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.610201 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.610295 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.610516 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.610616 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.610832 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.610934 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.611145 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.611282 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.611449 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.611543 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.611760 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.611864 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.612065 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.612157 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.612375 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.612465 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.612690 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.612856 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.612999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.613100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.613308 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.613408 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.613620 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.613752 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.613956 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.614055 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.614263 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.614356 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.614574 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.614675 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.614880 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.614971 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.615184 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.615282 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.615490 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.615599 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.615795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.615886 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.616103 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.616194 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.616409 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.616575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.616719 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.616851 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.617025 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.617126 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.617344 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.617444 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.617675 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.617816 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.617988 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.618085 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.618296 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.618390 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.618605 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.618706 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.618911 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.619012 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.619215 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.619306 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.619511 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.619656 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.619827 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.619983 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.620134 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.620228 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.620443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.620536 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.620755 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.620857 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.621057 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.621157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.621364 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.621463 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.621686 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.621796 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.621995 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.622088 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.622299 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.622391 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.622609 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.622709 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.622913 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.623555 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.624305 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.624305 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.624559 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.624673 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.624817 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.624952 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.625050 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.625282 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.625376 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.625469 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.625686 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.625794 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.626034 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.626147 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.626354 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.626450 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.628028 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.628267 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.628347 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.628440 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.628525 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.628607 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.628680 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.628863 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.628999 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.629152 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.629250 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.629342 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.629425 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.629734 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.629891 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.630036 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.630180 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.630299 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.630299 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.630543 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.630673 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.630799 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.630937 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.631077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.631217 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.631344 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.631464 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.631585 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.631716 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.631845 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.631983 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.632121 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.632258 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.632379 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.632379 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.632716 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.632839 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.632951 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.633070 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.633189 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.633311 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.633424 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.633536 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.633621 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.633621 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.633794 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.633882 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.634013 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.634127 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.634211 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.634323 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.634415 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.634644 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.634756 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.634957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.635049 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.635275 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.635457 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.635627 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.635780 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.635938 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.636090 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.636186 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.636269 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.636473 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.636612 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.636798 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.637014 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.637122 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.637257 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.637496 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.637596 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.637821 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.637933 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.638129 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.638240 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.638423 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.638545 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.639359 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.639515 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.639770 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.640276 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.640719 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.641044 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.641359 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.641721 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.642079 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.642401 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.642669 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.642766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.643030 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.643141 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.643405 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.643536 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.643751 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.643859 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.644063 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.644166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.644385 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.644693 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.644800 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.644885 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.644972 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.645054 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.645321 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.645426 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.645649 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.645784 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.645981 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.646083 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.646290 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.646394 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.646598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.646763 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.646923 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.647101 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.647230 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.647337 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.647561 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.647728 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.647874 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.647982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.648199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.648302 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.648511 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.648611 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.648830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.648986 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.649163 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.649302 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.649512 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.649627 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.649858 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.649978 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.650176 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.650270 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.650505 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.650602 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.650821 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.650925 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.651135 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.651227 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.651451 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.651550 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.651763 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.651865 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.652075 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.652176 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.652390 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.652484 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.652708 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.652801 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.653015 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.653152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.653327 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.653480 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.653621 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.653805 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.653972 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.654113 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.654833 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.655047 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.655273 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.655615 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.655708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.655937 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.656036 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.656257 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.656359 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.656590 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.656722 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.656909 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.657002 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.657240 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.657334 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.657552 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.657643 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.657889 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.657998 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.658201 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.658304 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.658530 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.658629 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.658838 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.658943 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.659143 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.659234 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.659453 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.659560 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.659764 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.659896 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.660070 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.660172 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.660379 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.660522 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.660707 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.660854 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.661016 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.661117 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.661343 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.661461 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.661685 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.661804 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.661986 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.662099 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.662300 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.662394 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.662613 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.662716 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.662938 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.663040 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.663252 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.663357 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.663563 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.663661 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.663868 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.663998 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.664172 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.664275 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.664481 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.664576 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.664792 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.664893 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.665115 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.665217 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.665427 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.665522 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.665763 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.665875 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.666077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.666180 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.666384 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.666479 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.666695 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.666796 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.667012 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.667115 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.667342 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.667598 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.667699 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.667935 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.668029 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.668255 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.668340 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.668564 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.668654 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.668873 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.668976 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.669180 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.669275 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.669487 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.669590 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.669837 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.669981 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.670896 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.671193 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.671290 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.671503 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.671608 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.671831 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.671935 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.672143 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.672238 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.672459 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.672554 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.672776 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.672871 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.673079 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.673187 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.673388 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.673493 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.673710 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.673829 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.674030 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.674217 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.674372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.674517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.674685 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.674833 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.674987 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.675138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.675285 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.675436 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.675610 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.675759 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.675906 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.676067 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.676210 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.676351 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.676511 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.676655 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.676836 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.676981 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.677150 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.677300 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.677464 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.677614 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.677805 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.677952 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.678094 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.678234 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.678422 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.678563 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.678714 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.678871 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.679073 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.679241 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.679385 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.679483 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.679655 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.679756 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.679997 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.680220 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.680323 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.680560 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.680776 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.680913 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.681247 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.681358 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.681453 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.681551 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.681749 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.681843 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.681928 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.682111 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.682205 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.682417 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.682518 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.682728 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.682821 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.683039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.683132 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.683350 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.683453 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.683663 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.683759 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.683967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.684136 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.684276 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.684377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.684580 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.684681 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.684895 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.684997 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.685203 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.685296 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.685568 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.685773 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.686021 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.686129 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.686338 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.686465 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.686651 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.686792 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.686963 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.687108 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.687276 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.687428 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.687580 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.687750 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.687899 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.688071 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.688206 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.688389 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.688512 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.688708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.688801 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.689029 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.689130 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.689350 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.689457 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.689684 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.689782 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.690058 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.690164 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.690317 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.690424 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.690636 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.690729 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.690942 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.691039 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.691261 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.691388 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.691567 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.691687 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.691869 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.691983 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.692178 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.692291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.692505 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.692616 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.692823 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.693042 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.693156 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.693365 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.693477 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.693727 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.693833 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.694034 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.694147 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.694342 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.694506 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.694653 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.694802 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.694971 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.695124 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.695278 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.695427 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.695575 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.695717 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.695865 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.696012 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.696160 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.696311 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.696457 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.696601 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.696750 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.696914 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.697056 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.697205 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.697346 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.697486 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.697635 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.697834 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.698021 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.698126 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.698332 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.698435 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.698693 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.698878 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.699006 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.699237 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.699331 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.699563 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.699663 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.699898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.699999 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.700231 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.700335 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.700544 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.700639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.700849 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.700989 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.701218 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.701673 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.701795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.702017 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.702111 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.702338 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.702439 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.702647 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.702742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.702955 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.703047 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.703281 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.703382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.703596 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.703704 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.703913 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.704017 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.704225 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.704318 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.704544 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.704646 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.704855 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.704948 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.705162 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.705262 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.705524 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.705633 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.705807 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.705900 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.706117 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.706293 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.706428 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.706523 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.706737 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.706828 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.707046 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.707152 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.707355 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.707448 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.707665 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.707774 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.707975 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.708081 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.708280 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.708371 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.708840 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.708948 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.709157 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.709263 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.709464 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.709564 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.709791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.709889 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.710111 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.710224 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.710421 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.710530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.710726 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.710821 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.711035 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.711129 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.711341 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.711450 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.711654 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.711759 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.711956 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.712058 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.712307 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.712445 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.712625 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.712760 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.712946 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.713041 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.713287 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.713380 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.713600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.713753 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.713946 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.714168 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.714289 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.714511 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.714640 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.714836 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.714942 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.715180 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.715328 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.715519 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.715622 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.715835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.715936 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.716147 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.716241 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.716455 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.716554 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.717335 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.717446 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.717709 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.718002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.718100 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.718336 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.718430 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.718647 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.718740 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.718960 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.719070 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.719271 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.719386 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.719588 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.719765 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.719915 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.720055 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.720207 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.720358 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.720498 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.720654 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.720797 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.720948 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.721099 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.721246 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.721448 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.721604 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.721803 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.721949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.722104 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.722261 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.722432 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.722588 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.722755 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.722912 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.723077 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.723238 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.723403 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.723544 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.723720 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.723858 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.724038 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.724170 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.724354 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.724486 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.724685 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.724834 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.724988 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.725109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.725321 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.725417 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.725640 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.725779 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.725973 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.726113 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.726372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.726467 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.726685 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.726787 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.727008 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.727112 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.727331 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.727437 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.727647 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.727749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.727978 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.728079 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.728306 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.728414 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.728620 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.728715 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.728936 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.729028 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.729241 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.729343 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.729551 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.729645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.729879 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.729982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.730184 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.730287 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.730509 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.730603 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.730815 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.730916 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.731127 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.731228 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.731439 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.731644 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.731737 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.731821 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.732041 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.732145 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.732410 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.733042 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.733267 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.733642 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.733775 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.733995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.734093 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.734309 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.734412 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.734624 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.734794 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.734949 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.735091 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.735233 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.735376 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.735541 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.735685 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.735825 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.735975 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.736117 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.736256 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.736418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.736562 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.736702 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.736843 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.736994 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.737142 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.737360 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.737521 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.737685 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.737791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.737909 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.738084 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.738221 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.738416 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.738516 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.738747 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.738847 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.739060 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.739155 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.739394 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.739487 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.739722 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.739822 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.740041 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.740136 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.740359 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.740453 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.740685 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.740778 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.740990 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.741084 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.741295 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.741428 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.741604 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.741847 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.741955 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.742104 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.742234 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.742357 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.742541 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.742659 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.742851 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.742963 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.743153 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.743265 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.743455 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.743570 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.743757 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.743860 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.744079 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.744190 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.744383 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.744500 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.744705 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.744816 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.745024 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.745125 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.745314 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.745419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.745618 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.745747 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.745964 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.746059 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.746296 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.746407 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.746607 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.746763 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.746931 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.747032 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.747247 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.747341 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.747569 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.747664 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.747884 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.747985 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.748245 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.748362 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.748568 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.748697 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.748885 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.749019 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.749202 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.749341 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.749525 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.749688 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.749874 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.749989 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.750209 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.750305 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.750540 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.750654 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.750856 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.750977 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.751186 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.751291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.751519 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.751685 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.751854 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.751957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.752139 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.752233 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.752507 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.752681 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.752838 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.753016 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.753159 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.753336 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.753483 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.753667 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.753826 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.754002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.754094 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 14:42:19.754319 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.754636 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.754952 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.755271 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.755586 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.755905 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.756235 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.756560 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.756887 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.757227 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.757546 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.757889 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.758209 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.758526 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.758887 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.759205 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.759515 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.759832 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.760149 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.760467 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.760780 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.761095 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.761410 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.761750 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.762070 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.762383 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.762695 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.763010 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.763336 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.764266 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.765000 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.765327 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.765651 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.765993 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.766528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.766851 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.767190 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.767524 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.767855 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.768177 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.768500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.768832 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.769144 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.769455 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.769797 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.770112 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.770420 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.770775 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.771059 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.771367 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.771689 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.772002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.772538 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.772886 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.773206 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.773534 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.773887 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.774207 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.774517 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.774844 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.775156 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.775465 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.775783 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.776101 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.776410 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.776720 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.777038 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.777346 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.777655 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.777991 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.778299 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.778628 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.778938 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.779330 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.780202 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.780588 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.780902 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.781215 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.781527 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.781864 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.782197 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.782485 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.782803 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.783109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.783424 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.783731 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.784044 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.784402 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.784730 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.785040 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.785348 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.785685 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.786010 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.786336 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.786653 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.787016 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.787367 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.787685 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.788222 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.788558 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.788879 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.789217 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.789550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.789964 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.790274 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.790581 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.790903 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.791214 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.791526 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.791838 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.792148 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.792459 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.792771 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.793079 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.793390 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.793729 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.794040 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.794350 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.794660 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.795045 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.795566 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.796032 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.796576 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.796576 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.796868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.797296 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.797813 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.797813 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.798133 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.798443 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.798759 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.799092 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.799408 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.799715 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.800141 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.800460 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.800780 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.801102 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.801414 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.801763 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.802092 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.802405 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.802744 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.803039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.803368 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.803709 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.804040 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.804368 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.804675 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.804980 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.805285 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.805599 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.805966 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.806276 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.806581 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.806886 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.807196 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.807500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.807802 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.808106 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.808406 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.808712 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.809013 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.809316 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.809619 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.809948 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.810252 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.810657 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.811376 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.811688 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.811999 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.812309 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.812614 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.812939 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.813254 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.813592 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.813972 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.814301 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.814616 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.814942 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.815254 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.815579 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.815912 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.816232 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.816546 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.816880 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.817194 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.817468 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO dbcounter [None req-f1606a5e-5d0c-48e9-af88-fb1fbb41c351 None None] Registered counter for database nova_api Jun 15 14:42:19.817565 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.817837 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.818153 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.818467 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.818781 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.819111 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.819441 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.819752 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.820079 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.820399 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.820722 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.821041 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.821354 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.821725 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.822045 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.822360 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.822676 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.823057 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.823304 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.823620 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.823936 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.824262 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.824589 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.824901 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.825230 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.825557 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.825936 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.827267 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.827624 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.827961 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.828283 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.828602 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.828913 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:42:19.829159 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 14:42:19.838133 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_db.sqlalchemy.engines [None req-f1606a5e-5d0c-48e9-af88-fb1fbb41c351 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124219) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:42:19.845421 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writer thread running {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:42:19.894813 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO dbcounter [None req-ce790fb5-87f6-4af2-8ed8-c2aea131f281 None None] Registered counter for database nova_api Jun 15 14:42:19.902385 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.context [None req-f1606a5e-5d0c-48e9-af88-fb1fbb41c351 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2a02d676-298d-47a3-8b1e-38c9694b2603(cell1) {{(pid=124219) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 14:42:19.906565 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f1606a5e-5d0c-48e9-af88-fb1fbb41c351 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:42:19.908140 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f1606a5e-5d0c-48e9-af88-fb1fbb41c351 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:42:19.908940 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f1606a5e-5d0c-48e9-af88-fb1fbb41c351 None None] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:42:19.910927 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f1606a5e-5d0c-48e9-af88-fb1fbb41c351 None None] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:42:19.912938 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO dbcounter [None req-f1606a5e-5d0c-48e9-af88-fb1fbb41c351 None None] Registered counter for database nova_cell0 Jun 15 14:42:19.914926 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_db.sqlalchemy.engines [None req-ce790fb5-87f6-4af2-8ed8-c2aea131f281 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124220) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:42:19.916885 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO dbcounter [None req-f1606a5e-5d0c-48e9-af88-fb1fbb41c351 None None] Registered counter for database nova_cell1 Jun 15 14:42:19.922930 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writer thread running {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:42:19.924872 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_db.sqlalchemy.engines [None req-f1606a5e-5d0c-48e9-af88-fb1fbb41c351 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124219) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:42:19.926978 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_db.sqlalchemy.engines [None req-f1606a5e-5d0c-48e9-af88-fb1fbb41c351 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124219) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:42:19.932981 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writer thread running {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:42:19.936176 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writer thread running {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:42:19.982171 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.context [None req-ce790fb5-87f6-4af2-8ed8-c2aea131f281 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2a02d676-298d-47a3-8b1e-38c9694b2603(cell1) {{(pid=124220) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 14:42:19.987430 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ce790fb5-87f6-4af2-8ed8-c2aea131f281 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:42:19.988992 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ce790fb5-87f6-4af2-8ed8-c2aea131f281 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:42:19.989818 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ce790fb5-87f6-4af2-8ed8-c2aea131f281 None None] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:42:19.991786 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ce790fb5-87f6-4af2-8ed8-c2aea131f281 None None] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:42:19.993832 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO dbcounter [None req-ce790fb5-87f6-4af2-8ed8-c2aea131f281 None None] Registered counter for database nova_cell0 Jun 15 14:42:19.997943 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO dbcounter [None req-ce790fb5-87f6-4af2-8ed8-c2aea131f281 None None] Registered counter for database nova_cell1 Jun 15 14:42:20.007055 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_db.sqlalchemy.engines [None req-ce790fb5-87f6-4af2-8ed8-c2aea131f281 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124220) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:42:20.009540 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_db.sqlalchemy.engines [None req-ce790fb5-87f6-4af2-8ed8-c2aea131f281 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124220) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:42:20.014790 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writer thread running {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:42:20.086193 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO dbcounter [None req-f1606a5e-5d0c-48e9-af88-fb1fbb41c351 None None] Registered counter for database nova_cell0 Jun 15 14:42:20.092960 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_db.sqlalchemy.engines [None req-f1606a5e-5d0c-48e9-af88-fb1fbb41c351 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124219) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:42:20.097523 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writer thread running {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:42:20.159721 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writer thread running {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:42:20.169489 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO dbcounter [None req-ce790fb5-87f6-4af2-8ed8-c2aea131f281 None None] Registered counter for database nova_cell0 Jun 15 14:42:20.177564 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_db.sqlalchemy.engines [None req-ce790fb5-87f6-4af2-8ed8-c2aea131f281 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124220) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:42:20.182410 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writer thread running {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:42:20.428397 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: WARNING keystonemiddleware.auth_token [None req-f1606a5e-5d0c-48e9-af88-fb1fbb41c351 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:42:20.436735 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: WARNING keystonemiddleware.auth_token [None req-f1606a5e-5d0c-48e9-af88-fb1fbb41c351 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:42:20.522308 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: WARNING keystonemiddleware.auth_token [None req-ce790fb5-87f6-4af2-8ed8-c2aea131f281 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:42:20.530163 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: WARNING keystonemiddleware.auth_token [None req-ce790fb5-87f6-4af2-8ed8-c2aea131f281 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:42:20.792410 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: WARNING keystonemiddleware.auth_token [None req-f1606a5e-5d0c-48e9-af88-fb1fbb41c351 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:42:20.799324 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: WARNING keystonemiddleware.auth_token [None req-f1606a5e-5d0c-48e9-af88-fb1fbb41c351 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:42:20.804703 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559df25ad9c0 pid: 124219 (default app) Jun 15 14:42:20.890981 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: WARNING keystonemiddleware.auth_token [None req-ce790fb5-87f6-4af2-8ed8-c2aea131f281 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:42:20.897026 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: WARNING keystonemiddleware.auth_token [None req-ce790fb5-87f6-4af2-8ed8-c2aea131f281 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:42:20.902322 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559df25ad9c0 pid: 124220 (default app) Jun 15 14:42:59.360249 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=3 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:42:59.361067 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=3 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:42:59.361900 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=3 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:42:59.362754 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=3 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:00.014619 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-ac0379cc-448e-4ebe-806a-9fa0611d768d tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] Action: 'create', calling method: .version_select at 0x7f8f21f0c820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-92716098"}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:01.640606 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-ac0379cc-448e-4ebe-806a-9fa0611d768d tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 2.302729 Jun 15 14:43:01.647863 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 1/1] 10.222.0.57 () {60 vars in 1154 bytes} [Wed Jun 15 14:42:59 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 2306 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 15 14:43:01.935321 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-d87e88f3-b118-45bf-9002-93d021fd7f11 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] Calling method '.version_select at 0x7f8f229139d0>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:01.965738 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=3 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:01.967797 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=3 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:01.969468 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=3 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:01.970512 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=3 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:03.189425 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-d87e88f3-b118-45bf-9002-93d021fd7f11 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/5b9f7089-840d-4752-8db1-8a7987110486" status: 200 len: 344 microversion: 2.1 time: 1.538759 Jun 15 14:43:03.191976 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 1/2] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Jun 15 14:43:01 2022] GET /compute/v2.1/os-volumes/5b9f7089-840d-4752-8db1-8a7987110486 => generated 344 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:03.217185 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-62edf339-d290-4176-a434-82488b2fb80b tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] Action: 'create', calling method: .version_select at 0x7f8f21dd65e0>, body: {"snapshot": {"volume_id": "5b9f7089-840d-4752-8db1-8a7987110486", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1977492943"}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:03.652851 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-62edf339-d290-4176-a434-82488b2fb80b tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] 10.222.0.57 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.441954 Jun 15 14:43:03.653466 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 2/3] 10.222.0.57 () {60 vars in 1161 bytes} [Wed Jun 15 14:43:03 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:03.664313 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1f6181ed-451f-4a7e-a76a-91fbea19fa1b tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] Calling method '.version_select at 0x7f8f21e19670>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:03.708939 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-1f6181ed-451f-4a7e-a76a-91fbea19fa1b tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/adec0965-0892-4f85-8e57-6b989119f7fc" status: 200 len: 287 microversion: 2.1 time: 0.048604 Jun 15 14:43:03.710049 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 2/4] 10.222.0.57 () {58 vars in 1250 bytes} [Wed Jun 15 14:43:03 2022] GET /compute/v2.1/os-snapshots/adec0965-0892-4f85-8e57-6b989119f7fc => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:03.720842 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e3a99b69-9558-4fee-a956-9948d8721309 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] Calling method '.version_select at 0x7f8f21dd6670>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:03.780038 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-e3a99b69-9558-4fee-a956-9948d8721309 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.063658 Jun 15 14:43:03.781399 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 3/5] 10.222.0.57 () {58 vars in 1139 bytes} [Wed Jun 15 14:43:03 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:03.792242 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-3457306b-c74a-4fbf-864a-b3c932f1075a tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] Calling method '.version_select at 0x7f8f21e19700>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:03.837928 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-3457306b-c74a-4fbf-864a-b3c932f1075a tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/adec0965-0892-4f85-8e57-6b989119f7fc" status: 200 len: 287 microversion: 2.1 time: 0.050124 Jun 15 14:43:03.839278 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 3/6] 10.222.0.57 () {58 vars in 1250 bytes} [Wed Jun 15 14:43:03 2022] GET /compute/v2.1/os-snapshots/adec0965-0892-4f85-8e57-6b989119f7fc => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:04.385682 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-9bc941e9-0f3d-4ce0-b562-424859547685 tempest-VolumesTestJSON-560405956 tempest-VolumesTestJSON-560405956-project] Calling method '.version_select at 0x7f8f21df13a0>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:04.507179 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-9bc941e9-0f3d-4ce0-b562-424859547685 tempest-VolumesTestJSON-560405956 tempest-VolumesTestJSON-560405956-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/2bdc43f6-976d-4473-917a-aeebb05db03c" status: 200 len: 351 microversion: 2.1 time: 0.125461 Jun 15 14:43:04.507762 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 4/7] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Jun 15 14:43:04 2022] GET /compute/v2.1/os-volumes/2bdc43f6-976d-4473-917a-aeebb05db03c => generated 351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:43:04.853998 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-d0c3eaf2-a4c7-43c9-adb3-91fd30f8e70a tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] Calling method '.version_select at 0x7f8f21e19e50>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:04.919124 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-d0c3eaf2-a4c7-43c9-adb3-91fd30f8e70a tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/adec0965-0892-4f85-8e57-6b989119f7fc" status: 200 len: 287 microversion: 2.1 time: 0.071447 Jun 15 14:43:04.920235 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 4/8] 10.222.0.57 () {58 vars in 1250 bytes} [Wed Jun 15 14:43:04 2022] GET /compute/v2.1/os-snapshots/adec0965-0892-4f85-8e57-6b989119f7fc => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:05.186005 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-ae4dc4cd-162d-4650-865a-6a352c7fbea4 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-498051456", "imageRef": "e18802bf-9dac-462c-88ba-5cce79043279", "flavorRef": "452", "networks": [{"uuid": "37c6703e-69ef-463a-ac85-7f57e935f665"}]}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:05.466646 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.network.neutron [None req-ae4dc4cd-162d-4650-865a-6a352c7fbea4 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] validate_networks() for [('37c6703e-69ef-463a-ac85-7f57e935f665', None, None, None, None, None)] {{(pid=124219) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:43:05.931500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-5e54c404-ccb1-46ef-b918-5a0e8a2d828d tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] Calling method '.version_select at 0x7f8f21dd3550>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:06.049525 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-5e54c404-ccb1-46ef-b918-5a0e8a2d828d tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/adec0965-0892-4f85-8e57-6b989119f7fc" status: 200 len: 287 microversion: 2.1 time: 0.121655 Jun 15 14:43:06.053642 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 5/9] 10.222.0.57 () {58 vars in 1250 bytes} [Wed Jun 15 14:43:05 2022] GET /compute/v2.1/os-snapshots/adec0965-0892-4f85-8e57-6b989119f7fc => generated 287 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:43:07.070229 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-112c644b-8529-4ae8-bbf7-1609d413bdbf tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] Calling method '.version_select at 0x7f8f21e19b80>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:07.123464 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-112c644b-8529-4ae8-bbf7-1609d413bdbf tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/adec0965-0892-4f85-8e57-6b989119f7fc" status: 200 len: 287 microversion: 2.1 time: 0.062423 Jun 15 14:43:07.124329 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 6/10] 10.222.0.57 () {58 vars in 1250 bytes} [Wed Jun 15 14:43:07 2022] GET /compute/v2.1/os-snapshots/adec0965-0892-4f85-8e57-6b989119f7fc => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:43:07.675016 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-2cea3914-e543-46d3-9d46-e333cf52f12b tempest-VolumesTestJSON-560405956 tempest-VolumesTestJSON-560405956-project] Calling method '.version_select at 0x7f8f21e199d0>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:07.823088 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-2cea3914-e543-46d3-9d46-e333cf52f12b tempest-VolumesTestJSON-560405956 tempest-VolumesTestJSON-560405956-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e1fab9cb-33c9-4c97-9992-98c2c74ae774" status: 200 len: 350 microversion: 2.1 time: 0.154287 Jun 15 14:43:07.823688 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 7/11] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Jun 15 14:43:07 2022] GET /compute/v2.1/os-volumes/e1fab9cb-33c9-4c97-9992-98c2c74ae774 => generated 350 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:08.107655 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-ae4dc4cd-162d-4650-865a-6a352c7fbea4 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Flavor limits 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:43:08.108180 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-ae4dc4cd-162d-4650-865a-6a352c7fbea4 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Image limits 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:43:08.109007 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-ae4dc4cd-162d-4650-865a-6a352c7fbea4 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Flavor pref 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:43:08.109517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-ae4dc4cd-162d-4650-865a-6a352c7fbea4 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Image pref 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:43:08.110471 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-ae4dc4cd-162d-4650-865a-6a352c7fbea4 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:43:08.136379 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-bc8d658f-de48-49af-a348-e928ac72f915 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] Calling method '.version_select at 0x7f8f21dd34c0>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:08.148757 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ae4dc4cd-162d-4650-865a-6a352c7fbea4 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:08.149258 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ae4dc4cd-162d-4650-865a-6a352c7fbea4 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:08.151616 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ae4dc4cd-162d-4650-865a-6a352c7fbea4 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:08.152094 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ae4dc4cd-162d-4650-865a-6a352c7fbea4 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:08.261363 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-ae4dc4cd-162d-4650-865a-6a352c7fbea4 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Getting quotas for project 3f4caa81d58a4daf90980e624d1c2526. Resources: {'cores', 'instances', 'ram'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:43:08.270522 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-ae4dc4cd-162d-4650-865a-6a352c7fbea4 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Getting quotas for user 05add5effa924b908fc522cb16f8387c and project 3f4caa81d58a4daf90980e624d1c2526. Resources: {'cores', 'instances', 'ram'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:43:08.287331 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-ae4dc4cd-162d-4650-865a-6a352c7fbea4 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Going to run 1 instances... {{(pid=124219) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:43:08.292267 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-ae4dc4cd-162d-4650-865a-6a352c7fbea4 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e18802bf-9dac-462c-88ba-5cce79043279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124219) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:43:08.361708 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-bc8d658f-de48-49af-a348-e928ac72f915 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/adec0965-0892-4f85-8e57-6b989119f7fc" status: 200 len: 288 microversion: 2.1 time: 0.228811 Jun 15 14:43:08.362532 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 8/12] 10.222.0.57 () {58 vars in 1250 bytes} [Wed Jun 15 14:43:08 2022] GET /compute/v2.1/os-snapshots/adec0965-0892-4f85-8e57-6b989119f7fc => generated 288 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:43:08.373302 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-ddc488c0-9540-46fd-9ac4-ca8a2d6b3bd1 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] Calling method '.version_select at 0x7f8f21e19430>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:08.496901 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-ae4dc4cd-162d-4650-865a-6a352c7fbea4 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.422030 Jun 15 14:43:08.502100 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 5/13] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 14:43:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:43:08.516900 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-287a92a7-fc21-40c9-b732-0ec6277af01e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:08.517647 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-287a92a7-fc21-40c9-b732-0ec6277af01e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:08.592473 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-ddc488c0-9540-46fd-9ac4-ca8a2d6b3bd1 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] 10.222.0.57 "DELETE /compute/v2.1/os-snapshots/adec0965-0892-4f85-8e57-6b989119f7fc" status: 202 len: 0 microversion: 2.1 time: 0.222494 Jun 15 14:43:08.593544 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 9/14] 10.222.0.57 () {58 vars in 1253 bytes} [Wed Jun 15 14:43:08 2022] DELETE /compute/v2.1/os-snapshots/adec0965-0892-4f85-8e57-6b989119f7fc => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:43:08.601768 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-7a60bf7c-3c9f-4649-aea7-6d36dced0f71 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] Calling method '.version_select at 0x7f8f21e19ee0>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:08.685650 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-7a60bf7c-3c9f-4649-aea7-6d36dced0f71 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/adec0965-0892-4f85-8e57-6b989119f7fc" status: 200 len: 287 microversion: 2.1 time: 0.087523 Jun 15 14:43:08.686271 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 10/15] 10.222.0.57 () {58 vars in 1250 bytes} [Wed Jun 15 14:43:08 2022] GET /compute/v2.1/os-snapshots/adec0965-0892-4f85-8e57-6b989119f7fc => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:43:08.845035 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-287a92a7-fc21-40c9-b732-0ec6277af01e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:08.879991 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-287a92a7-fc21-40c9-b732-0ec6277af01e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1214 microversion: 2.1 time: 0.375339 Jun 15 14:43:08.881058 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 6/16] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:08 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1214 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:09.703978 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c68c40d3-3ddc-455c-a9ae-64bc8ed965b5 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] Calling method '.version_select at 0x7f8f21dd3670>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:09.755695 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.wsgi [None req-c68c40d3-3ddc-455c-a9ae-64bc8ed965b5 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] HTTP exception thrown: Snapshot adec0965-0892-4f85-8e57-6b989119f7fc could not be found. Jun 15 14:43:09.763109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c68c40d3-3ddc-455c-a9ae-64bc8ed965b5 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] Request method failure captured: Jun 15 14:43:09.763109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: request: GET /compute/v2.1/os-snapshots/adec0965-0892-4f85-8e57-6b989119f7fc HTTP/1.1 Jun 15 14:43:09.763109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept: application/json Jun 15 14:43:09.763109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept-Encoding: identity Jun 15 14:43:09.763109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Connection: close Jun 15 14:43:09.763109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Length: 0 Jun 15 14:43:09.763109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Type: application/json Jun 15 14:43:09.763109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Host: 10.222.0.57 Jun 15 14:43:09.763109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Openstack-System-Scope: None Jun 15 14:43:09.763109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: User-Agent: python-urllib3/1.26.9 Jun 15 14:43:09.763109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Auth-Token: gAAAAABiqe_zxHoUxQU8gqezWPTF6VH3zkjgm5LpK0pY-9ESqlY2vug23nMVgivrBKwBcAex4VmBYJIhz1yqeJwcsNsVT1rXG0_vwax1nyvNSWblMU-9ERpbCXCpL039HXeYhL7AqwTv2BlqtVy13u86UDWlGQKapNfkAtNS3XL-623QB_GfY8c Jun 15 14:43:09.763109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Id: None Jun 15 14:43:09.763109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Name: None Jun 15 14:43:09.763109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Identity-Status: Confirmed Jun 15 14:43:09.763109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Is-Admin-Project: True Jun 15 14:43:09.763109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Id: default Jun 15 14:43:09.763109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Name: Default Jun 15 14:43:09.763109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Id: 658ef56d424e4381a1fba60ebedf0277 Jun 15 14:43:09.763109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-88687331 Jun 15 14:43:09.763109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Role: member,reader Jun 15 14:43:09.763109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Roles: member,reader Jun 15 14:43:09.764446 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/658ef56d424e4381a1fba60ebedf0277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_658ef56d424e4381a1fba60ebedf0277", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/658ef56d424e4381a1fba60ebedf0277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/658ef56d424e4381a1fba60ebedf0277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:43:09.764446 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant: tempest-VolumesSnapshotsTestJSON-88687331 Jun 15 14:43:09.764446 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Id: 658ef56d424e4381a1fba60ebedf0277 Jun 15 14:43:09.764446 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-88687331 Jun 15 14:43:09.764446 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User: tempest-VolumesSnapshotsTestJSON-88687331-project Jun 15 14:43:09.764446 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Id: default Jun 15 14:43:09.764446 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Name: Default Jun 15 14:43:09.764446 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Id: 4735488a206c4a2da7873c310a95a91e Jun 15 14:43:09.764446 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Name: tempest-VolumesSnapshotsTestJSON-88687331-project Jun 15 14:43:09.764446 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: method: Jun 15 14:43:09.764446 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: exception: Snapshot adec0965-0892-4f85-8e57-6b989119f7fc could not be found. Jun 15 14:43:09.764446 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: action_args: {'id': 'adec0965-0892-4f85-8e57-6b989119f7fc'} Jun 15 14:43:09.764446 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:43:09.765353 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:09.765353 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 15 14:43:09.765353 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 15 14:43:09.765353 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 15 14:43:09.765353 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 15 14:43:09.765353 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 15 14:43:09.765353 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 15 14:43:09.765353 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:43:09.765353 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:43:09.765353 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:43:09.765353 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:43:09.765353 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:43:09.765353 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:43:09.765353 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:43:09.765353 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:43:09.765353 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot adec0965-0892-4f85-8e57-6b989119f7fc could not be found. (HTTP 404) (Request-ID: req-5f5b7804-b36d-44a3-b281-897359aa3591) Jun 15 14:43:09.765353 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:43:09.765353 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:09.766507 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:43:09.766507 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:09.766507 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 15 14:43:09.766507 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 15 14:43:09.766507 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 14:43:09.766507 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 14:43:09.766507 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 15 14:43:09.766507 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 15 14:43:09.766507 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 14:43:09.766507 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 14:43:09.766507 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 15 14:43:09.766507 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 15 14:43:09.766507 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 15 14:43:09.766507 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 15 14:43:09.766507 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 15 14:43:09.766507 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 15 14:43:09.766507 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:43:09.766507 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:43:09.766507 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:43:09.768199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:43:09.768199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:43:09.768199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:43:09.768199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:43:09.768199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:43:09.768199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot adec0965-0892-4f85-8e57-6b989119f7fc could not be found. Jun 15 14:43:09.768199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:43:09.768199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:09.768199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:43:09.768199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:09.768199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:09.768199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:09.768199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:43:09.768199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:43:09.768199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:43:09.768199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:43:09.768199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:43:09.768199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:43:09.768199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 15 14:43:09.768199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:43:09.769784 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot adec0965-0892-4f85-8e57-6b989119f7fc could not be found. Jun 15 14:43:09.769784 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:43:09.769784 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:09.769784 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:43:09.769784 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:09.769784 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:09.769784 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:09.769784 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:43:09.769784 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:43:09.769784 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot adec0965-0892-4f85-8e57-6b989119f7fc could not be found. Jun 15 14:43:09.769784 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:43:09.770904 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c68c40d3-3ddc-455c-a9ae-64bc8ed965b5 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] Returning 404 to user: Snapshot adec0965-0892-4f85-8e57-6b989119f7fc could not be found. {{(pid=124220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:43:09.771626 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-c68c40d3-3ddc-455c-a9ae-64bc8ed965b5 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/adec0965-0892-4f85-8e57-6b989119f7fc" status: 404 len: 111 microversion: 2.1 time: 0.077229 Jun 15 14:43:09.774104 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 11/17] 10.222.0.57 () {58 vars in 1250 bytes} [Wed Jun 15 14:43:09 2022] GET /compute/v2.1/os-snapshots/adec0965-0892-4f85-8e57-6b989119f7fc => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:43:09.781976 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-9d06f65b-75f1-42d5-bf2a-2388d9c225c3 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] Calling method '.version_select at 0x7f8f214a00d0>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:09.816979 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-77dd8ec1-2f57-4162-8722-7dd7f5b62613 tempest-VolumesTestJSON-560405956 tempest-VolumesTestJSON-560405956-project] Calling method '.version_select at 0x7f8f21d48160>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:09.938957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-9d06f65b-75f1-42d5-bf2a-2388d9c225c3 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/5b9f7089-840d-4752-8db1-8a7987110486" status: 202 len: 0 microversion: 2.1 time: 0.161921 Jun 15 14:43:09.940644 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 7/18] 10.222.0.57 () {58 vars in 1247 bytes} [Wed Jun 15 14:43:09 2022] DELETE /compute/v2.1/os-volumes/5b9f7089-840d-4752-8db1-8a7987110486 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:43:09.948142 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-448446af-ecba-46ff-af98-226b83fce093 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:09.950230 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-448446af-ecba-46ff-af98-226b83fce093 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:10.001143 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-77dd8ec1-2f57-4162-8722-7dd7f5b62613 tempest-VolumesTestJSON-560405956 tempest-VolumesTestJSON-560405956-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/2280d59f-f04c-43ff-ad1c-af6d6818bdc1" status: 200 len: 350 microversion: 2.1 time: 0.188174 Jun 15 14:43:10.002374 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 12/19] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Jun 15 14:43:09 2022] GET /compute/v2.1/os-volumes/2280d59f-f04c-43ff-ad1c-af6d6818bdc1 => generated 350 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:43:10.010013 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-179295f0-3877-49d8-8152-c384274d77c2 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] Calling method '.version_select at 0x7f8f21d48700>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:10.140735 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-179295f0-3877-49d8-8152-c384274d77c2 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/5b9f7089-840d-4752-8db1-8a7987110486" status: 200 len: 343 microversion: 2.1 time: 0.136975 Jun 15 14:43:10.141689 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 13/20] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Jun 15 14:43:10 2022] GET /compute/v2.1/os-volumes/5b9f7089-840d-4752-8db1-8a7987110486 => generated 343 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:10.147780 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-209e7d62-056b-46ad-95c0-6e1cdafeb074 tempest-VolumesTestJSON-560405956 tempest-VolumesTestJSON-560405956-project] Calling method '.version_select at 0x7f8f21d48a60>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:10.402486 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-209e7d62-056b-46ad-95c0-6e1cdafeb074 tempest-VolumesTestJSON-560405956 tempest-VolumesTestJSON-560405956-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.258025 Jun 15 14:43:10.403567 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 14/21] 10.222.0.57 () {58 vars in 1133 bytes} [Wed Jun 15 14:43:10 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:10.417212 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-7b471b20-f71f-4655-8575-076f36e7e57e tempest-VolumesTestJSON-560405956 tempest-VolumesTestJSON-560405956-project] Calling method '.version_select at 0x7f8f21d48d30>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:10.590479 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-7b471b20-f71f-4655-8575-076f36e7e57e tempest-VolumesTestJSON-560405956 tempest-VolumesTestJSON-560405956-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.177070 Jun 15 14:43:10.592366 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 15/22] 10.222.0.57 () {58 vars in 1148 bytes} [Wed Jun 15 14:43:10 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:10.604254 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-7847c527-cb02-4db3-9efb-37b9eb8247f6 tempest-VolumesTestJSON-560405956 tempest-VolumesTestJSON-560405956-project] Calling method '.version_select at 0x7f8f21d483a0>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:10.610748 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-448446af-ecba-46ff-af98-226b83fce093 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:10.624290 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-448446af-ecba-46ff-af98-226b83fce093 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1214 microversion: 2.1 time: 0.682283 Jun 15 14:43:10.628402 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 8/23] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:09 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1214 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:10.749512 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-7847c527-cb02-4db3-9efb-37b9eb8247f6 tempest-VolumesTestJSON-560405956 tempest-VolumesTestJSON-560405956-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.149451 Jun 15 14:43:10.751224 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 16/24] 10.222.0.57 () {58 vars in 1133 bytes} [Wed Jun 15 14:43:10 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:10.763513 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-ba172373-c70b-43a3-9605-43d5cf96e3fb tempest-VolumesTestJSON-560405956 tempest-VolumesTestJSON-560405956-project] Calling method '.version_select at 0x7f8f214aeaf0>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:10.980608 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-ba172373-c70b-43a3-9605-43d5cf96e3fb tempest-VolumesTestJSON-560405956 tempest-VolumesTestJSON-560405956-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.220426 Jun 15 14:43:10.981514 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 9/25] 10.222.0.57 () {58 vars in 1166 bytes} [Wed Jun 15 14:43:10 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:10.994388 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-f27b3d85-f7d1-4650-98bd-f227d467efc5 tempest-VolumesTestJSON-560405956 tempest-VolumesTestJSON-560405956-project] Calling method '.version_select at 0x7f8f21dd3e50>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:11.155052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0e2a2e71-be06-41de-8d1c-c3bf1f2c8c33 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] Calling method '.version_select at 0x7f8f214819d0>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:11.192233 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-f27b3d85-f7d1-4650-98bd-f227d467efc5 tempest-VolumesTestJSON-560405956 tempest-VolumesTestJSON-560405956-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.202757 Jun 15 14:43:11.193061 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 17/26] 10.222.0.57 () {58 vars in 1169 bytes} [Wed Jun 15 14:43:10 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:11.204387 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-0e2a2e71-be06-41de-8d1c-c3bf1f2c8c33 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] HTTP exception thrown: Volume 5b9f7089-840d-4752-8db1-8a7987110486 could not be found. Jun 15 14:43:11.206349 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-e7112da6-a5c8-4574-bbc5-2f3745421af6 tempest-VolumesTestJSON-560405956 tempest-VolumesTestJSON-560405956-project] Calling method '.version_select at 0x7f8f21d5aa60>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:11.209329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0e2a2e71-be06-41de-8d1c-c3bf1f2c8c33 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] Request method failure captured: Jun 15 14:43:11.209329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: GET /compute/v2.1/os-volumes/5b9f7089-840d-4752-8db1-8a7987110486 HTTP/1.1 Jun 15 14:43:11.209329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:43:11.209329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:43:11.209329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:43:11.209329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:43:11.209329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:43:11.209329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:43:11.209329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:43:11.209329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:43:11.209329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqe_zxHoUxQU8gqezWPTF6VH3zkjgm5LpK0pY-9ESqlY2vug23nMVgivrBKwBcAex4VmBYJIhz1yqeJwcsNsVT1rXG0_vwax1nyvNSWblMU-9ERpbCXCpL039HXeYhL7AqwTv2BlqtVy13u86UDWlGQKapNfkAtNS3XL-623QB_GfY8c Jun 15 14:43:11.209329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:43:11.209329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:43:11.209329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:43:11.209329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:43:11.209329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:43:11.209329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:43:11.209329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 658ef56d424e4381a1fba60ebedf0277 Jun 15 14:43:11.209329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-88687331 Jun 15 14:43:11.209329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:43:11.209329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:43:11.210961 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/658ef56d424e4381a1fba60ebedf0277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_658ef56d424e4381a1fba60ebedf0277", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/658ef56d424e4381a1fba60ebedf0277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/658ef56d424e4381a1fba60ebedf0277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:43:11.210961 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-VolumesSnapshotsTestJSON-88687331 Jun 15 14:43:11.210961 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 658ef56d424e4381a1fba60ebedf0277 Jun 15 14:43:11.210961 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-88687331 Jun 15 14:43:11.210961 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-VolumesSnapshotsTestJSON-88687331-project Jun 15 14:43:11.210961 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:43:11.210961 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:43:11.210961 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 4735488a206c4a2da7873c310a95a91e Jun 15 14:43:11.210961 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-VolumesSnapshotsTestJSON-88687331-project Jun 15 14:43:11.210961 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: Jun 15 14:43:11.210961 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Volume 5b9f7089-840d-4752-8db1-8a7987110486 could not be found. Jun 15 14:43:11.210961 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': '5b9f7089-840d-4752-8db1-8a7987110486'} Jun 15 14:43:11.210961 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:43:11.211785 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:11.211785 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:43:11.211785 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:43:11.211785 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 14:43:11.211785 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 14:43:11.211785 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 14:43:11.211785 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 14:43:11.211785 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:43:11.211785 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:43:11.211785 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:43:11.211785 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:43:11.211785 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:43:11.211785 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:43:11.211785 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:43:11.211785 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:43:11.211785 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5b9f7089-840d-4752-8db1-8a7987110486 could not be found. (HTTP 404) (Request-ID: req-18294eec-94fb-4883-b860-e767cc4192fe) Jun 15 14:43:11.211785 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:43:11.211785 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:11.211785 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:43:11.212999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:11.212999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 14:43:11.212999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 14:43:11.212999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 14:43:11.212999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 14:43:11.212999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 14:43:11.212999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 14:43:11.212999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 14:43:11.212999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 14:43:11.212999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:43:11.212999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:43:11.212999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 14:43:11.212999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 14:43:11.212999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 14:43:11.212999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 14:43:11.212999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:43:11.212999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:43:11.212999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:43:11.212999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:43:11.214056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:43:11.214056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:43:11.214056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:43:11.214056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:43:11.214056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5b9f7089-840d-4752-8db1-8a7987110486 could not be found. Jun 15 14:43:11.214056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:43:11.214056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:11.214056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:43:11.214056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:11.214056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:11.214056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:11.214056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:43:11.214056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:43:11.214056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:43:11.214056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:43:11.214056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:43:11.214056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:43:11.214056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 14:43:11.214056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:43:11.215086 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5b9f7089-840d-4752-8db1-8a7987110486 could not be found. Jun 15 14:43:11.215086 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:43:11.215086 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:11.215086 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:43:11.215086 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:11.215086 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:11.215086 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:11.215086 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:43:11.215086 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:43:11.215086 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5b9f7089-840d-4752-8db1-8a7987110486 could not be found. Jun 15 14:43:11.215086 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:43:11.216740 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0e2a2e71-be06-41de-8d1c-c3bf1f2c8c33 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] Returning 404 to user: Volume 5b9f7089-840d-4752-8db1-8a7987110486 could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:43:11.217883 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-0e2a2e71-be06-41de-8d1c-c3bf1f2c8c33 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/5b9f7089-840d-4752-8db1-8a7987110486" status: 404 len: 109 microversion: 2.1 time: 0.068152 Jun 15 14:43:11.219350 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 10/27] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Jun 15 14:43:11 2022] GET /compute/v2.1/os-volumes/5b9f7089-840d-4752-8db1-8a7987110486 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:43:11.228907 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-31bd19d8-774e-449c-bfdc-4c1d7965b605 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] Calling method '.version_select at 0x7f8f214ba040>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:11.276111 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-31bd19d8-774e-449c-bfdc-4c1d7965b605 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] HTTP exception thrown: Volume 5b9f7089-840d-4752-8db1-8a7987110486 could not be found. Jun 15 14:43:11.278418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-31bd19d8-774e-449c-bfdc-4c1d7965b605 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] Request method failure captured: Jun 15 14:43:11.278418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: DELETE /compute/v2.1/os-volumes/5b9f7089-840d-4752-8db1-8a7987110486 HTTP/1.1 Jun 15 14:43:11.278418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:43:11.278418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:43:11.278418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:43:11.278418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:43:11.278418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:43:11.278418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:43:11.278418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:43:11.278418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:43:11.278418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqe_zxHoUxQU8gqezWPTF6VH3zkjgm5LpK0pY-9ESqlY2vug23nMVgivrBKwBcAex4VmBYJIhz1yqeJwcsNsVT1rXG0_vwax1nyvNSWblMU-9ERpbCXCpL039HXeYhL7AqwTv2BlqtVy13u86UDWlGQKapNfkAtNS3XL-623QB_GfY8c Jun 15 14:43:11.278418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:43:11.278418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:43:11.278418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:43:11.278418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:43:11.278418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:43:11.278418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:43:11.278418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 658ef56d424e4381a1fba60ebedf0277 Jun 15 14:43:11.278418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-88687331 Jun 15 14:43:11.278418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:43:11.278418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:43:11.280028 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/658ef56d424e4381a1fba60ebedf0277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_658ef56d424e4381a1fba60ebedf0277", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/658ef56d424e4381a1fba60ebedf0277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/658ef56d424e4381a1fba60ebedf0277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:43:11.280028 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-VolumesSnapshotsTestJSON-88687331 Jun 15 14:43:11.280028 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 658ef56d424e4381a1fba60ebedf0277 Jun 15 14:43:11.280028 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-88687331 Jun 15 14:43:11.280028 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-VolumesSnapshotsTestJSON-88687331-project Jun 15 14:43:11.280028 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:43:11.280028 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:43:11.280028 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 4735488a206c4a2da7873c310a95a91e Jun 15 14:43:11.280028 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-VolumesSnapshotsTestJSON-88687331-project Jun 15 14:43:11.280028 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: Jun 15 14:43:11.280028 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Volume 5b9f7089-840d-4752-8db1-8a7987110486 could not be found. Jun 15 14:43:11.280028 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': '5b9f7089-840d-4752-8db1-8a7987110486'} Jun 15 14:43:11.280028 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:43:11.280829 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:11.280829 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:43:11.280829 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:43:11.280829 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 14:43:11.280829 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 14:43:11.280829 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 14:43:11.280829 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 14:43:11.280829 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 14:43:11.280829 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 14:43:11.280829 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 14:43:11.280829 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 14:43:11.280829 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:43:11.280829 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:43:11.280829 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:43:11.280829 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:43:11.280829 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5b9f7089-840d-4752-8db1-8a7987110486 could not be found. (HTTP 404) (Request-ID: req-4697a65f-fdeb-4d1d-8c92-50db63468198) Jun 15 14:43:11.280829 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:43:11.280829 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:11.280829 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:43:11.282165 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:11.282165 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 14:43:11.282165 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 14:43:11.282165 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 14:43:11.282165 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 14:43:11.282165 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 14:43:11.282165 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 14:43:11.282165 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 14:43:11.282165 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 14:43:11.282165 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:43:11.282165 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:43:11.282165 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 14:43:11.282165 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 14:43:11.282165 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 14:43:11.282165 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 14:43:11.282165 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 14:43:11.282165 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 14:43:11.282165 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 14:43:11.282165 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 14:43:11.283037 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:43:11.283037 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:43:11.283037 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:43:11.283037 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:43:11.283037 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5b9f7089-840d-4752-8db1-8a7987110486 could not be found. Jun 15 14:43:11.283037 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:43:11.283037 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:11.283037 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:43:11.283037 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:11.283037 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:11.283037 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:11.283037 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:43:11.283037 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:43:11.283037 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:43:11.283037 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:43:11.283037 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:43:11.283037 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:43:11.283037 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 14:43:11.283037 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:43:11.283922 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5b9f7089-840d-4752-8db1-8a7987110486 could not be found. Jun 15 14:43:11.283922 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:43:11.283922 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:11.283922 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:43:11.283922 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:11.283922 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:11.283922 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:11.283922 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:43:11.283922 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:43:11.283922 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5b9f7089-840d-4752-8db1-8a7987110486 could not be found. Jun 15 14:43:11.283922 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:43:11.285177 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-31bd19d8-774e-449c-bfdc-4c1d7965b605 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] Returning 404 to user: Volume 5b9f7089-840d-4752-8db1-8a7987110486 could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:43:11.286197 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-31bd19d8-774e-449c-bfdc-4c1d7965b605 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/5b9f7089-840d-4752-8db1-8a7987110486" status: 404 len: 109 microversion: 2.1 time: 0.061841 Jun 15 14:43:11.287186 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 11/28] 10.222.0.57 () {58 vars in 1247 bytes} [Wed Jun 15 14:43:11 2022] DELETE /compute/v2.1/os-volumes/5b9f7089-840d-4752-8db1-8a7987110486 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:43:11.295622 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-7ae95bd7-3138-4969-886a-d923be63ed62 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] Calling method '.version_select at 0x7f8f214ba670>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:11.340840 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-7ae95bd7-3138-4969-886a-d923be63ed62 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] HTTP exception thrown: Volume 5b9f7089-840d-4752-8db1-8a7987110486 could not be found. Jun 15 14:43:11.349530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-7ae95bd7-3138-4969-886a-d923be63ed62 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] Request method failure captured: Jun 15 14:43:11.349530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: GET /compute/v2.1/os-volumes/5b9f7089-840d-4752-8db1-8a7987110486 HTTP/1.1 Jun 15 14:43:11.349530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:43:11.349530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:43:11.349530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:43:11.349530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:43:11.349530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:43:11.349530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:43:11.349530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:43:11.349530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:43:11.349530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqe_zxHoUxQU8gqezWPTF6VH3zkjgm5LpK0pY-9ESqlY2vug23nMVgivrBKwBcAex4VmBYJIhz1yqeJwcsNsVT1rXG0_vwax1nyvNSWblMU-9ERpbCXCpL039HXeYhL7AqwTv2BlqtVy13u86UDWlGQKapNfkAtNS3XL-623QB_GfY8c Jun 15 14:43:11.349530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:43:11.349530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:43:11.349530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:43:11.349530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:43:11.349530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:43:11.349530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:43:11.349530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 658ef56d424e4381a1fba60ebedf0277 Jun 15 14:43:11.349530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-88687331 Jun 15 14:43:11.349530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:43:11.349530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:43:11.351212 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/658ef56d424e4381a1fba60ebedf0277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_658ef56d424e4381a1fba60ebedf0277", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/658ef56d424e4381a1fba60ebedf0277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/658ef56d424e4381a1fba60ebedf0277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:43:11.351212 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-VolumesSnapshotsTestJSON-88687331 Jun 15 14:43:11.351212 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 658ef56d424e4381a1fba60ebedf0277 Jun 15 14:43:11.351212 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-88687331 Jun 15 14:43:11.351212 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-VolumesSnapshotsTestJSON-88687331-project Jun 15 14:43:11.351212 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:43:11.351212 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:43:11.351212 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 4735488a206c4a2da7873c310a95a91e Jun 15 14:43:11.351212 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-VolumesSnapshotsTestJSON-88687331-project Jun 15 14:43:11.351212 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: Jun 15 14:43:11.351212 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Volume 5b9f7089-840d-4752-8db1-8a7987110486 could not be found. Jun 15 14:43:11.351212 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': '5b9f7089-840d-4752-8db1-8a7987110486'} Jun 15 14:43:11.351212 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:43:11.351990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:11.351990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:43:11.351990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:43:11.351990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 14:43:11.351990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 14:43:11.351990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 14:43:11.351990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 14:43:11.351990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:43:11.351990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:43:11.351990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:43:11.351990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:43:11.351990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:43:11.351990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:43:11.351990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:43:11.351990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:43:11.351990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5b9f7089-840d-4752-8db1-8a7987110486 could not be found. (HTTP 404) (Request-ID: req-0501913c-1768-47fa-ac92-3e13197e1855) Jun 15 14:43:11.351990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:43:11.351990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:11.351990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:43:11.353441 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:11.353441 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 14:43:11.353441 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 14:43:11.353441 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 14:43:11.353441 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 14:43:11.353441 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 14:43:11.353441 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 14:43:11.353441 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 14:43:11.353441 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 14:43:11.353441 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:43:11.353441 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:43:11.353441 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 14:43:11.353441 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 14:43:11.353441 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 14:43:11.353441 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 14:43:11.353441 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:43:11.353441 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:43:11.353441 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:43:11.353441 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:43:11.355995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:43:11.355995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:43:11.355995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:43:11.355995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:43:11.355995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5b9f7089-840d-4752-8db1-8a7987110486 could not be found. Jun 15 14:43:11.355995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:43:11.355995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:11.355995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:43:11.355995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:11.355995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:11.355995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:11.355995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:43:11.355995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:43:11.355995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:43:11.355995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:43:11.355995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:43:11.355995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:43:11.355995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 14:43:11.355995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:43:11.357680 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5b9f7089-840d-4752-8db1-8a7987110486 could not be found. Jun 15 14:43:11.357680 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:43:11.357680 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:11.357680 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:43:11.357680 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:11.357680 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:11.357680 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:11.357680 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:43:11.357680 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:43:11.357680 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5b9f7089-840d-4752-8db1-8a7987110486 could not be found. Jun 15 14:43:11.357680 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:43:11.357680 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-7ae95bd7-3138-4969-886a-d923be63ed62 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] Returning 404 to user: Volume 5b9f7089-840d-4752-8db1-8a7987110486 could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:43:11.359238 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-7ae95bd7-3138-4969-886a-d923be63ed62 tempest-VolumesSnapshotsTestJSON-88687331 tempest-VolumesSnapshotsTestJSON-88687331-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/5b9f7089-840d-4752-8db1-8a7987110486" status: 404 len: 109 microversion: 2.1 time: 0.064883 Jun 15 14:43:11.362256 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 12/29] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Jun 15 14:43:11 2022] GET /compute/v2.1/os-volumes/5b9f7089-840d-4752-8db1-8a7987110486 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 14:43:11.364389 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-e7112da6-a5c8-4574-bbc5-2f3745421af6 tempest-VolumesTestJSON-560405956 tempest-VolumesTestJSON-560405956-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.161552 Jun 15 14:43:11.365428 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 18/30] 10.222.0.57 () {58 vars in 1154 bytes} [Wed Jun 15 14:43:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:11.379048 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-6d636b67-ff1c-4fec-9464-6034699a4125 tempest-VolumesTestJSON-560405956 tempest-VolumesTestJSON-560405956-project] Calling method '.version_select at 0x7f8f20c22550>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:11.525091 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-6d636b67-ff1c-4fec-9464-6034699a4125 tempest-VolumesTestJSON-560405956 tempest-VolumesTestJSON-560405956-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.149779 Jun 15 14:43:11.525796 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 13/31] 10.222.0.57 () {58 vars in 1187 bytes} [Wed Jun 15 14:43:11 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:11.545270 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-2246aea7-a81b-45c2-8778-54d08ffe019e tempest-VolumesTestJSON-560405956 tempest-VolumesTestJSON-560405956-project] Calling method '.version_select at 0x7f8f21d5a820>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:11.645255 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-27d90593-bffa-4859-b0f4-dea3d323cca1 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:11.648299 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-27d90593-bffa-4859-b0f4-dea3d323cca1 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:11.662492 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-27d90593-bffa-4859-b0f4-dea3d323cca1 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:11.663377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-27d90593-bffa-4859-b0f4-dea3d323cca1 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:11.667156 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-27d90593-bffa-4859-b0f4-dea3d323cca1 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:11.667829 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-27d90593-bffa-4859-b0f4-dea3d323cca1 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:11.709542 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-2246aea7-a81b-45c2-8778-54d08ffe019e tempest-VolumesTestJSON-560405956 tempest-VolumesTestJSON-560405956-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.174158 Jun 15 14:43:11.724207 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 19/32] 10.222.0.57 () {58 vars in 1154 bytes} [Wed Jun 15 14:43:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:12.227802 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-27d90593-bffa-4859-b0f4-dea3d323cca1 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:12.265443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-27d90593-bffa-4859-b0f4-dea3d323cca1 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1266 microversion: 2.1 time: 0.622107 Jun 15 14:43:12.266281 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 14/33] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:11 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1266 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:12.943985 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-639f4c1a-a9d0-423e-94fb-2301e37b57da tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Action: 'create', calling method: .version_select at 0x7f8f21dd30d0>, body: {"keypair": {"name": "tempest-keypair-62574201", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1IRvaJtMgfmk/fznmWMneDn4imnXUpTNX6K4ANDblZWgsLwIvCweJMDy4ChZeLO3Fht9TzjFboFXbXgP2MM1ck3A63JnoUX+NB5fLnBM61sl51P26n1DnM6bxLAYU2uQ=="}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:13.081160 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-639f4c1a-a9d0-423e-94fb-2301e37b57da tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Getting quotas for project 4bf1cdbd5dc9471f9f1732600ab98c24. Resources: {'key_pairs'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:43:13.104797 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-639f4c1a-a9d0-423e-94fb-2301e37b57da tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Getting quotas for user 1d58ac7f49454fd6a5b5eef6a1e8b2d8 and project 4bf1cdbd5dc9471f9f1732600ab98c24. Resources: {'key_pairs'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:43:13.262079 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-639f4c1a-a9d0-423e-94fb-2301e37b57da tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.555927 Jun 15 14:43:13.264169 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 20/34] 10.222.0.57 () {62 vars in 1199 bytes} [Wed Jun 15 14:43:12 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 558 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 15 14:43:13.284182 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-ec2e21c7-44ee-4b20-80dd-d0fafad0b518 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:13.284976 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-ec2e21c7-44ee-4b20-80dd-d0fafad0b518 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:13.314307 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ec2e21c7-44ee-4b20-80dd-d0fafad0b518 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:13.315719 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ec2e21c7-44ee-4b20-80dd-d0fafad0b518 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:13.318374 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ec2e21c7-44ee-4b20-80dd-d0fafad0b518 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:13.322664 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ec2e21c7-44ee-4b20-80dd-d0fafad0b518 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:14.208121 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-ec2e21c7-44ee-4b20-80dd-d0fafad0b518 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:14.217329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-ec2e21c7-44ee-4b20-80dd-d0fafad0b518 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1272 microversion: 2.1 time: 0.936938 Jun 15 14:43:14.221774 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 15/35] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:13 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1272 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:15.254264 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c979aad7-8e2b-45f9-8d71-a9b5b7ec4b00 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:15.256120 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-c979aad7-8e2b-45f9-8d71-a9b5b7ec4b00 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:15.281156 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c979aad7-8e2b-45f9-8d71-a9b5b7ec4b00 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:15.281824 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c979aad7-8e2b-45f9-8d71-a9b5b7ec4b00 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:15.283744 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c979aad7-8e2b-45f9-8d71-a9b5b7ec4b00 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:15.284385 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c979aad7-8e2b-45f9-8d71-a9b5b7ec4b00 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:15.838546 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-c979aad7-8e2b-45f9-8d71-a9b5b7ec4b00 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:15.868626 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-c979aad7-8e2b-45f9-8d71-a9b5b7ec4b00 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1272 microversion: 2.1 time: 0.628715 Jun 15 14:43:15.881322 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 21/36] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:15 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1272 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:16.888669 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-54fa0fdc-43b7-457a-9881-100950febb96 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:16.889953 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-54fa0fdc-43b7-457a-9881-100950febb96 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:16.908983 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-54fa0fdc-43b7-457a-9881-100950febb96 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:16.911507 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-54fa0fdc-43b7-457a-9881-100950febb96 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:16.913286 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-54fa0fdc-43b7-457a-9881-100950febb96 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:16.916625 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-54fa0fdc-43b7-457a-9881-100950febb96 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:17.417689 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-54fa0fdc-43b7-457a-9881-100950febb96 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:17.432738 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-54fa0fdc-43b7-457a-9881-100950febb96 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1272 microversion: 2.1 time: 0.545780 Jun 15 14:43:17.451088 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 16/37] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:16 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1272 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:18.457365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-cc6865df-0dd4-41c8-a575-30f222c9b345 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:18.458040 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-cc6865df-0dd4-41c8-a575-30f222c9b345 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:18.475909 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cc6865df-0dd4-41c8-a575-30f222c9b345 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:18.476372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cc6865df-0dd4-41c8-a575-30f222c9b345 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:18.477167 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cc6865df-0dd4-41c8-a575-30f222c9b345 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:18.477604 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cc6865df-0dd4-41c8-a575-30f222c9b345 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:18.744281 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=2 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:19.429428 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-189515a0-933a-467e-9b0e-09f788d62882 tempest-VolumesGetTestJSON-286431070 tempest-VolumesGetTestJSON-286431070-project] Action: 'create', calling method: .version_select at 0x7f8f20b535e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1425554145", "metadata": {"Type": "work"}}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:20.342103 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-189515a0-933a-467e-9b0e-09f788d62882 tempest-VolumesGetTestJSON-286431070 tempest-VolumesGetTestJSON-286431070-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.602262 Jun 15 14:43:20.343450 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 17/38] 10.222.0.57 () {60 vars in 1155 bytes} [Wed Jun 15 14:43:18 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1606 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 15 14:43:20.364096 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-627c7d58-4b0c-4fc9-b778-04dc100f8064 tempest-VolumesGetTestJSON-286431070 tempest-VolumesGetTestJSON-286431070-project] Calling method '.version_select at 0x7f8f20b61430>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:20.535431 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-627c7d58-4b0c-4fc9-b778-04dc100f8064 tempest-VolumesGetTestJSON-286431070 tempest-VolumesGetTestJSON-286431070-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/ddd24b86-3475-4338-8a70-0b4f686c581c" status: 200 len: 353 microversion: 2.1 time: 0.184422 Jun 15 14:43:20.536473 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 18/39] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Jun 15 14:43:20 2022] GET /compute/v2.1/os-volumes/ddd24b86-3475-4338-8a70-0b4f686c581c => generated 353 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:20.622303 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-cc6865df-0dd4-41c8-a575-30f222c9b345 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:20.644229 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-cc6865df-0dd4-41c8-a575-30f222c9b345 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1314 microversion: 2.1 time: 2.182065 Jun 15 14:43:20.645419 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 22/40] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:18 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1314 bytes in 2193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:21.522568 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=10 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:21.548785 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-541d3ed9-8271-46f7-b815-8e21d38bea8c tempest-VolumesGetTestJSON-286431070 tempest-VolumesGetTestJSON-286431070-project] Calling method '.version_select at 0x7f8f213c6b80>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:21.745584 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-541d3ed9-8271-46f7-b815-8e21d38bea8c tempest-VolumesGetTestJSON-286431070 tempest-VolumesGetTestJSON-286431070-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/ddd24b86-3475-4338-8a70-0b4f686c581c" status: 200 len: 354 microversion: 2.1 time: 0.201051 Jun 15 14:43:21.746516 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 23/41] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Jun 15 14:43:21 2022] GET /compute/v2.1/os-volumes/ddd24b86-3475-4338-8a70-0b4f686c581c => generated 354 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:21.751523 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-2481e51d-1362-4dbb-aef3-a1a26871ffad tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:21.752144 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-2481e51d-1362-4dbb-aef3-a1a26871ffad tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:21.771591 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2481e51d-1362-4dbb-aef3-a1a26871ffad tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:21.772051 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2481e51d-1362-4dbb-aef3-a1a26871ffad tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:21.786544 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2481e51d-1362-4dbb-aef3-a1a26871ffad tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:21.787011 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2481e51d-1362-4dbb-aef3-a1a26871ffad tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:22.168069 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-2481e51d-1362-4dbb-aef3-a1a26871ffad tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:22.180449 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-2481e51d-1362-4dbb-aef3-a1a26871ffad tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1314 microversion: 2.1 time: 0.432889 Jun 15 14:43:22.185485 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 24/42] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:21 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:22.194874 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-b1138418-9018-4107-abc5-77de605930bb tempest-VolumesGetTestJSON-286431070 tempest-VolumesGetTestJSON-286431070-project] Calling method '.version_select at 0x7f8f2141ba60>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:22.392604 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-b1138418-9018-4107-abc5-77de605930bb tempest-VolumesGetTestJSON-286431070 tempest-VolumesGetTestJSON-286431070-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/ddd24b86-3475-4338-8a70-0b4f686c581c" status: 200 len: 354 microversion: 2.1 time: 0.204618 Jun 15 14:43:22.394206 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 25/43] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Jun 15 14:43:22 2022] GET /compute/v2.1/os-volumes/ddd24b86-3475-4338-8a70-0b4f686c581c => generated 354 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:22.407283 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-80d59cc8-9cd2-4813-a4a3-47c2ecd1559f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1697318084", "imageRef": "e18802bf-9dac-462c-88ba-5cce79043279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "144e5733-1650-4b80-90c9-abe595a9b128"}], "security_groups": [{"name": "tempest-securitygroup--1080406320"}], "key_name": "tempest-keypair-62574201", "user_data": "}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:22.743300 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-70fcc5df-2540-4939-b1c6-6be2b6c8da54 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Action: 'create', calling method: .version_select at 0x7f8f20b999d0>, body: {"keypair": {"name": "tempest-keypair-1290012804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK27X4/SmHb1VG234MAKWSf/97PrHFeF0mDyd+r7186GSUR0eXZydIH4PScC7z7jUFjdNw5IN1bpdffNv6GH3v4JP6YGUXcU0V4dbZmczyt5/OWqNDby1AYRe+toIYlbPw=="}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:22.797954 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.network.neutron [None req-80d59cc8-9cd2-4813-a4a3-47c2ecd1559f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] validate_networks() for [('144e5733-1650-4b80-90c9-abe595a9b128', None, None, None, None, None)] {{(pid=124220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:43:22.867088 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-70fcc5df-2540-4939-b1c6-6be2b6c8da54 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Getting quotas for project 0c12c8e1398843eca8746543a0684841. Resources: {'key_pairs'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:43:22.887530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-70fcc5df-2540-4939-b1c6-6be2b6c8da54 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Getting quotas for user 28ff37865a9b49ec8601140fca00a627 and project 0c12c8e1398843eca8746543a0684841. Resources: {'key_pairs'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:43:22.961777 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-70fcc5df-2540-4939-b1c6-6be2b6c8da54 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.439485 Jun 15 14:43:22.972500 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 19/44] 10.222.0.57 () {60 vars in 1158 bytes} [Wed Jun 15 14:43:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:22.989331 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-bc9379f5-b139-4fb9-a817-c93903f43264 tempest-VolumesGetTestJSON-286431070 tempest-VolumesGetTestJSON-286431070-project] Calling method '.version_select at 0x7f8f20b53c10>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:23.145100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=4 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:23.212829 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-bc9379f5-b139-4fb9-a817-c93903f43264 tempest-VolumesGetTestJSON-286431070 tempest-VolumesGetTestJSON-286431070-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/ddd24b86-3475-4338-8a70-0b4f686c581c" status: 202 len: 0 microversion: 2.1 time: 0.236237 Jun 15 14:43:23.216744 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 20/45] 10.222.0.57 () {58 vars in 1247 bytes} [Wed Jun 15 14:43:22 2022] DELETE /compute/v2.1/os-volumes/ddd24b86-3475-4338-8a70-0b4f686c581c => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:43:23.743563 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-74f6acde-532d-4f13-b17c-f62d0b966fa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-152844723", "imageRef": "e18802bf-9dac-462c-88ba-5cce79043279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:23.873649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.network.neutron [None req-74f6acde-532d-4f13-b17c-f62d0b966fa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] validate_networks() for [('81a884fa-a70c-46e6-b401-b5d5d80eaa1f', None, None, None, None, None)] {{(pid=124219) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:43:25.090044 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-80d59cc8-9cd2-4813-a4a3-47c2ecd1559f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Flavor limits 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:43:25.090619 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-80d59cc8-9cd2-4813-a4a3-47c2ecd1559f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Image limits 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:43:25.090936 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-80d59cc8-9cd2-4813-a4a3-47c2ecd1559f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Flavor pref 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:43:25.091586 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-80d59cc8-9cd2-4813-a4a3-47c2ecd1559f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Image pref 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:43:25.092602 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-80d59cc8-9cd2-4813-a4a3-47c2ecd1559f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:43:25.123546 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-80d59cc8-9cd2-4813-a4a3-47c2ecd1559f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:25.124231 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-80d59cc8-9cd2-4813-a4a3-47c2ecd1559f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:25.125361 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-80d59cc8-9cd2-4813-a4a3-47c2ecd1559f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:25.126071 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-80d59cc8-9cd2-4813-a4a3-47c2ecd1559f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:25.179264 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-80d59cc8-9cd2-4813-a4a3-47c2ecd1559f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Getting quotas for project 4bf1cdbd5dc9471f9f1732600ab98c24. Resources: {'cores', 'instances', 'ram'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:43:25.194978 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-80d59cc8-9cd2-4813-a4a3-47c2ecd1559f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Getting quotas for user 1d58ac7f49454fd6a5b5eef6a1e8b2d8 and project 4bf1cdbd5dc9471f9f1732600ab98c24. Resources: {'cores', 'instances', 'ram'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:43:25.248765 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-80d59cc8-9cd2-4813-a4a3-47c2ecd1559f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Going to run 1 instances... {{(pid=124220) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:43:25.260200 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-80d59cc8-9cd2-4813-a4a3-47c2ecd1559f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e18802bf-9dac-462c-88ba-5cce79043279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:43:25.537018 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-80d59cc8-9cd2-4813-a4a3-47c2ecd1559f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.141519 Jun 15 14:43:25.545789 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 26/46] 10.222.0.57 () {62 vars in 1187 bytes} [Wed Jun 15 14:43:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 3151 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 15 14:43:25.562050 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-f83cf0cc-5895-46fa-a043-065e66788f0a tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:25.565191 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-f83cf0cc-5895-46fa-a043-065e66788f0a tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:25.600571 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f83cf0cc-5895-46fa-a043-065e66788f0a tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:25.601414 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f83cf0cc-5895-46fa-a043-065e66788f0a tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:25.604815 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f83cf0cc-5895-46fa-a043-065e66788f0a tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:25.607503 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f83cf0cc-5895-46fa-a043-065e66788f0a tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:26.539777 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-74f6acde-532d-4f13-b17c-f62d0b966fa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Flavor limits 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:43:26.552124 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-74f6acde-532d-4f13-b17c-f62d0b966fa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Image limits 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:43:26.553915 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-74f6acde-532d-4f13-b17c-f62d0b966fa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Flavor pref 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:43:26.555186 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-74f6acde-532d-4f13-b17c-f62d0b966fa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Image pref 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:43:26.561643 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-74f6acde-532d-4f13-b17c-f62d0b966fa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:43:26.632518 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-74f6acde-532d-4f13-b17c-f62d0b966fa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:26.634373 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-74f6acde-532d-4f13-b17c-f62d0b966fa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:26.636639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-74f6acde-532d-4f13-b17c-f62d0b966fa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:26.639088 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-74f6acde-532d-4f13-b17c-f62d0b966fa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:26.715315 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-74f6acde-532d-4f13-b17c-f62d0b966fa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Getting quotas for project 26d36b3b04f046d3bee421c5987b965b. Resources: {'cores', 'instances', 'ram'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:43:26.725547 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-74f6acde-532d-4f13-b17c-f62d0b966fa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Getting quotas for user ed7372fed3e14f3e98ca25d22a7c7a7e and project 26d36b3b04f046d3bee421c5987b965b. Resources: {'cores', 'instances', 'ram'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:43:26.774689 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-74f6acde-532d-4f13-b17c-f62d0b966fa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Going to run 1 instances... {{(pid=124219) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:43:26.780863 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-74f6acde-532d-4f13-b17c-f62d0b966fa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e18802bf-9dac-462c-88ba-5cce79043279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124219) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:43:26.781091 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-f83cf0cc-5895-46fa-a043-065e66788f0a tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:26.797440 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-f83cf0cc-5895-46fa-a043-065e66788f0a tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1314 microversion: 2.1 time: 1.250245 Jun 15 14:43:26.798800 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 27/47] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:25 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1314 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:26.830244 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-52651c61-961d-460c-b8ce-b2d4c5ab2641 tempest-VolumesGetTestJSON-286431070 tempest-VolumesGetTestJSON-286431070-project] Calling method '.version_select at 0x7f8f21364af0>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:26.935282 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-74f6acde-532d-4f13-b17c-f62d0b966fa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.719390 Jun 15 14:43:26.943408 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 21/48] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 14:43:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 3728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:43:26.953082 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-60339ef7-5f75-4bf3-b366-c695c15395e7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:26.954881 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-60339ef7-5f75-4bf3-b366-c695c15395e7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:27.051415 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.wsgi [None req-52651c61-961d-460c-b8ce-b2d4c5ab2641 tempest-VolumesGetTestJSON-286431070 tempest-VolumesGetTestJSON-286431070-project] HTTP exception thrown: Volume ddd24b86-3475-4338-8a70-0b4f686c581c could not be found. Jun 15 14:43:27.054223 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-52651c61-961d-460c-b8ce-b2d4c5ab2641 tempest-VolumesGetTestJSON-286431070 tempest-VolumesGetTestJSON-286431070-project] Request method failure captured: Jun 15 14:43:27.054223 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: request: GET /compute/v2.1/os-volumes/ddd24b86-3475-4338-8a70-0b4f686c581c HTTP/1.1 Jun 15 14:43:27.054223 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept: application/json Jun 15 14:43:27.054223 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept-Encoding: identity Jun 15 14:43:27.054223 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Connection: close Jun 15 14:43:27.054223 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Length: 0 Jun 15 14:43:27.054223 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Type: application/json Jun 15 14:43:27.054223 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Host: 10.222.0.57 Jun 15 14:43:27.054223 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Openstack-System-Scope: None Jun 15 14:43:27.054223 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: User-Agent: python-urllib3/1.26.9 Jun 15 14:43:27.054223 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Auth-Token: gAAAAABiqfAGBHkdBemR0jS4P1zt6fbvchEWoED0HSi_YMfvJB8ukve6aNh7BNbBBOlCmNpMlpXdVpmhUp6iICXPvCNnc_-NdUNS1tJwa6AMeEBLTnGzl-RadqOhAkZLpVq4n8_yuLgZU51m9u9nqgkX_5d7C4knc3auSG1TZyC87sgDwNBGLgI Jun 15 14:43:27.054223 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Id: None Jun 15 14:43:27.054223 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Name: None Jun 15 14:43:27.054223 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Identity-Status: Confirmed Jun 15 14:43:27.054223 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Is-Admin-Project: True Jun 15 14:43:27.054223 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Id: default Jun 15 14:43:27.054223 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Name: Default Jun 15 14:43:27.054223 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Id: e730a4e6489d4e7480445b8210e15566 Jun 15 14:43:27.054223 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Name: tempest-VolumesGetTestJSON-286431070 Jun 15 14:43:27.054223 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Role: member,reader Jun 15 14:43:27.054223 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Roles: member,reader Jun 15 14:43:27.055442 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e730a4e6489d4e7480445b8210e15566"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e730a4e6489d4e7480445b8210e15566", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e730a4e6489d4e7480445b8210e15566"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e730a4e6489d4e7480445b8210e15566"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:43:27.055442 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant: tempest-VolumesGetTestJSON-286431070 Jun 15 14:43:27.055442 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Id: e730a4e6489d4e7480445b8210e15566 Jun 15 14:43:27.055442 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Name: tempest-VolumesGetTestJSON-286431070 Jun 15 14:43:27.055442 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User: tempest-VolumesGetTestJSON-286431070-project Jun 15 14:43:27.055442 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Id: default Jun 15 14:43:27.055442 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Name: Default Jun 15 14:43:27.055442 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Id: 36bff42e33854d2ca51b28a1c5118eba Jun 15 14:43:27.055442 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Name: tempest-VolumesGetTestJSON-286431070-project Jun 15 14:43:27.055442 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: method: Jun 15 14:43:27.055442 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: exception: Volume ddd24b86-3475-4338-8a70-0b4f686c581c could not be found. Jun 15 14:43:27.055442 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: action_args: {'id': 'ddd24b86-3475-4338-8a70-0b4f686c581c'} Jun 15 14:43:27.055442 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:43:27.056196 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:27.056196 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:43:27.056196 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:43:27.056196 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 14:43:27.056196 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 14:43:27.056196 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 14:43:27.056196 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 14:43:27.056196 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:43:27.056196 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:43:27.056196 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:43:27.056196 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:43:27.056196 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:43:27.056196 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:43:27.056196 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:43:27.056196 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:43:27.056196 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ddd24b86-3475-4338-8a70-0b4f686c581c could not be found. (HTTP 404) (Request-ID: req-524c63a2-1e1e-4df6-8802-e0f8507da058) Jun 15 14:43:27.056196 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:43:27.056196 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:27.056196 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:43:27.057454 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:27.057454 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 14:43:27.057454 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 14:43:27.057454 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 14:43:27.057454 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 14:43:27.057454 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 14:43:27.057454 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 14:43:27.057454 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 14:43:27.057454 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 14:43:27.057454 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:43:27.057454 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:43:27.057454 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 14:43:27.057454 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 14:43:27.057454 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 14:43:27.057454 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 14:43:27.057454 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:43:27.057454 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:43:27.057454 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:43:27.057454 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:43:27.058667 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:43:27.058667 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:43:27.058667 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:43:27.058667 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:43:27.058667 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ddd24b86-3475-4338-8a70-0b4f686c581c could not be found. Jun 15 14:43:27.058667 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:43:27.058667 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:27.058667 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:43:27.058667 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:27.058667 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:27.058667 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:27.058667 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:43:27.058667 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:43:27.058667 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:43:27.058667 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:43:27.058667 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:43:27.058667 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:43:27.058667 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 14:43:27.058667 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:43:27.060576 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ddd24b86-3475-4338-8a70-0b4f686c581c could not be found. Jun 15 14:43:27.060576 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:43:27.060576 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:27.060576 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:43:27.060576 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:27.060576 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:27.060576 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:27.060576 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:43:27.060576 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:43:27.060576 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ddd24b86-3475-4338-8a70-0b4f686c581c could not be found. Jun 15 14:43:27.060576 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:43:27.062679 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-52651c61-961d-460c-b8ce-b2d4c5ab2641 tempest-VolumesGetTestJSON-286431070 tempest-VolumesGetTestJSON-286431070-project] Returning 404 to user: Volume ddd24b86-3475-4338-8a70-0b4f686c581c could not be found. {{(pid=124220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:43:27.064092 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-52651c61-961d-460c-b8ce-b2d4c5ab2641 tempest-VolumesGetTestJSON-286431070 tempest-VolumesGetTestJSON-286431070-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/ddd24b86-3475-4338-8a70-0b4f686c581c" status: 404 len: 109 microversion: 2.1 time: 0.263968 Jun 15 14:43:27.065254 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 28/49] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Jun 15 14:43:26 2022] GET /compute/v2.1/os-volumes/ddd24b86-3475-4338-8a70-0b4f686c581c => generated 109 bytes in 266 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:43:27.645495 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-60339ef7-5f75-4bf3-b366-c695c15395e7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:27.656039 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-60339ef7-5f75-4bf3-b366-c695c15395e7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:27.660904 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-60339ef7-5f75-4bf3-b366-c695c15395e7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:27.672300 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-60339ef7-5f75-4bf3-b366-c695c15395e7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1280 microversion: 2.20 time: 0.725516 Jun 15 14:43:27.679948 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 22/50] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:26 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1280 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:27.692911 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-61e4c449-22a0-47db-91e8-c822f12d2dc0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:27.698785 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-61e4c449-22a0-47db-91e8-c822f12d2dc0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:27.789510 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-f605f21b-d76e-48da-8017-c2a44ff6f50c req-886ea18d-ba9b-4e92-875a-dc890fe1cc1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61c1ec95-3f54-48c5-99d2-004d76ceed87", "tag": "d3e3b078-39b7-46d0-885a-6c877f026556"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:27.842473 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-f605f21b-d76e-48da-8017-c2a44ff6f50c req-886ea18d-ba9b-4e92-875a-dc890fe1cc1f service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:27.844670 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-f605f21b-d76e-48da-8017-c2a44ff6f50c req-886ea18d-ba9b-4e92-875a-dc890fe1cc1f service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:27.952633 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-f605f21b-d76e-48da-8017-c2a44ff6f50c req-886ea18d-ba9b-4e92-875a-dc890fe1cc1f service nova] Creating event network-changed:d3e3b078-39b7-46d0-885a-6c877f026556 for instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 on hv-cinder-84327 Jun 15 14:43:27.953351 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-f605f21b-d76e-48da-8017-c2a44ff6f50c req-886ea18d-ba9b-4e92-875a-dc890fe1cc1f service nova] Acquired lock "compute-rpcapi-router" {{(pid=124220) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 15 14:43:27.964326 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-434f3008-dcdb-499e-98f3-2935460701d3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:27.964772 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-434f3008-dcdb-499e-98f3-2935460701d3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:27.965741 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-434f3008-dcdb-499e-98f3-2935460701d3 None None] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:27.988418 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-434f3008-dcdb-499e-98f3-2935460701d3 None None] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:28.052656 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.compute.rpcapi [None req-434f3008-dcdb-499e-98f3-2935460701d3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 15 14:43:28.055609 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-434f3008-dcdb-499e-98f3-2935460701d3 None None] Releasing lock "compute-rpcapi-router" {{(pid=124220) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 15 14:43:28.116688 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-434f3008-dcdb-499e-98f3-2935460701d3 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.049875 Jun 15 14:43:28.117689 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 29/51] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:28.131899 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-114546cd-a96a-45bf-a67d-667afbeb6326 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:28.135058 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-114546cd-a96a-45bf-a67d-667afbeb6326 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:28.163224 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-114546cd-a96a-45bf-a67d-667afbeb6326 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:28.182517 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-114546cd-a96a-45bf-a67d-667afbeb6326 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:28.193543 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-114546cd-a96a-45bf-a67d-667afbeb6326 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:28.197024 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-114546cd-a96a-45bf-a67d-667afbeb6326 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:28.781194 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-61e4c449-22a0-47db-91e8-c822f12d2dc0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:28.793647 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-61e4c449-22a0-47db-91e8-c822f12d2dc0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1221 microversion: 2.1 time: 1.112355 Jun 15 14:43:28.829269 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 23/52] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:27 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1221 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:28.834429 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-7b05122b-7b89-4d20-a165-a1582d82074f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:28.837047 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-7b05122b-7b89-4d20-a165-a1582d82074f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:28.845964 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7b05122b-7b89-4d20-a165-a1582d82074f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:28.846813 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7b05122b-7b89-4d20-a165-a1582d82074f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:28.848185 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7b05122b-7b89-4d20-a165-a1582d82074f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:28.848892 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7b05122b-7b89-4d20-a165-a1582d82074f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:29.052645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-7b05122b-7b89-4d20-a165-a1582d82074f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:29.078057 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-7b05122b-7b89-4d20-a165-a1582d82074f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:29.086865 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-7b05122b-7b89-4d20-a165-a1582d82074f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:29.088592 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-7b05122b-7b89-4d20-a165-a1582d82074f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1276 microversion: 2.20 time: 0.257912 Jun 15 14:43:29.094054 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 24/53] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:28 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1276 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:29.238579 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-44910d72-df06-489f-8959-3450caca9555 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-384149530", "imageRef": "e18802bf-9dac-462c-88ba-5cce79043279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:29.240046 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-114546cd-a96a-45bf-a67d-667afbeb6326 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:29.250690 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-114546cd-a96a-45bf-a67d-667afbeb6326 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1314 microversion: 2.1 time: 1.131621 Jun 15 14:43:29.251256 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 30/54] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:28 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1314 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:29.333155 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.network.neutron [None req-44910d72-df06-489f-8959-3450caca9555 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] validate_networks() for [('81a884fa-a70c-46e6-b401-b5d5d80eaa1f', None, None, None, None, None)] {{(pid=124219) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:43:29.759724 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-65ff8be8-56db-4449-83b4-d6dfdf45e2ce tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1602550211", "imageRef": "e18802bf-9dac-462c-88ba-5cce79043279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9d6c1cb5-f05b-4061-8227-1b062e46210a"}], "security_groups": [{"name": "tempest-securitygroup--625346283"}], "key_name": "tempest-keypair-1290012804", "user_data": "}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:30.003748 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.network.neutron [None req-65ff8be8-56db-4449-83b4-d6dfdf45e2ce tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] validate_networks() for [('9d6c1cb5-f05b-4061-8227-1b062e46210a', None, None, None, None, None)] {{(pid=124220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:43:30.345247 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-44910d72-df06-489f-8959-3450caca9555 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Flavor limits 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:43:30.345822 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-44910d72-df06-489f-8959-3450caca9555 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Image limits 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:43:30.346184 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-44910d72-df06-489f-8959-3450caca9555 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Flavor pref 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:43:30.346602 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-44910d72-df06-489f-8959-3450caca9555 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Image pref 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:43:30.347125 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-44910d72-df06-489f-8959-3450caca9555 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:43:30.349252 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=7 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:30.364355 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-44910d72-df06-489f-8959-3450caca9555 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:30.364805 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-44910d72-df06-489f-8959-3450caca9555 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:30.378261 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-44910d72-df06-489f-8959-3450caca9555 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:30.379083 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-44910d72-df06-489f-8959-3450caca9555 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:30.455704 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=29 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:30.534531 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-44910d72-df06-489f-8959-3450caca9555 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Getting quotas for project 26d36b3b04f046d3bee421c5987b965b. Resources: {'cores', 'instances', 'ram'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:43:30.542898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-44910d72-df06-489f-8959-3450caca9555 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Getting quotas for user ed7372fed3e14f3e98ca25d22a7c7a7e and project 26d36b3b04f046d3bee421c5987b965b. Resources: {'cores', 'instances', 'ram'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:43:30.596048 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-44910d72-df06-489f-8959-3450caca9555 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Going to run 1 instances... {{(pid=124219) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:43:30.598588 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-44910d72-df06-489f-8959-3450caca9555 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e18802bf-9dac-462c-88ba-5cce79043279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124219) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:43:30.719727 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-44910d72-df06-489f-8959-3450caca9555 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.486234 Jun 15 14:43:30.720570 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 25/55] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 14:43:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 1488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:43:30.739103 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-56796cb8-5973-4606-9806-059243421a27 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:30.742068 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-56796cb8-5973-4606-9806-059243421a27 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:30.755381 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-56796cb8-5973-4606-9806-059243421a27 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:30.757571 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-56796cb8-5973-4606-9806-059243421a27 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:30.760299 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-56796cb8-5973-4606-9806-059243421a27 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:30.762994 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-56796cb8-5973-4606-9806-059243421a27 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:30.820402 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-65ff8be8-56db-4449-83b4-d6dfdf45e2ce tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Flavor limits 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:43:30.821089 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-65ff8be8-56db-4449-83b4-d6dfdf45e2ce tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Image limits 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:43:30.821915 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-65ff8be8-56db-4449-83b4-d6dfdf45e2ce tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Flavor pref 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:43:30.822335 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-65ff8be8-56db-4449-83b4-d6dfdf45e2ce tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Image pref 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:43:30.823194 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-65ff8be8-56db-4449-83b4-d6dfdf45e2ce tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:43:30.847787 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-65ff8be8-56db-4449-83b4-d6dfdf45e2ce tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:30.854134 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-65ff8be8-56db-4449-83b4-d6dfdf45e2ce tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:30.861145 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-65ff8be8-56db-4449-83b4-d6dfdf45e2ce tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:30.861622 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-65ff8be8-56db-4449-83b4-d6dfdf45e2ce tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:30.875317 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-56796cb8-5973-4606-9806-059243421a27 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:30.885571 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-56796cb8-5973-4606-9806-059243421a27 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:30.887490 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-56796cb8-5973-4606-9806-059243421a27 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:30.889879 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-56796cb8-5973-4606-9806-059243421a27 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1340 microversion: 2.20 time: 0.160444 Jun 15 14:43:30.891084 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 26/56] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:30 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1340 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:30.897210 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-37c38db9-dc26-448b-8419-04110d7b52d9 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:30.898180 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-37c38db9-dc26-448b-8419-04110d7b52d9 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:30.907730 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-37c38db9-dc26-448b-8419-04110d7b52d9 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:30.908346 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-37c38db9-dc26-448b-8419-04110d7b52d9 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:30.911478 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-37c38db9-dc26-448b-8419-04110d7b52d9 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:30.912131 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-37c38db9-dc26-448b-8419-04110d7b52d9 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:30.984346 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-65ff8be8-56db-4449-83b4-d6dfdf45e2ce tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Getting quotas for project 0c12c8e1398843eca8746543a0684841. Resources: {'cores', 'instances', 'ram'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:43:30.994836 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-65ff8be8-56db-4449-83b4-d6dfdf45e2ce tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Getting quotas for user 28ff37865a9b49ec8601140fca00a627 and project 0c12c8e1398843eca8746543a0684841. Resources: {'cores', 'instances', 'ram'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:43:31.067533 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-65ff8be8-56db-4449-83b4-d6dfdf45e2ce tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Going to run 1 instances... {{(pid=124220) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:43:31.078268 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-65ff8be8-56db-4449-83b4-d6dfdf45e2ce tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e18802bf-9dac-462c-88ba-5cce79043279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:43:31.284630 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-65ff8be8-56db-4449-83b4-d6dfdf45e2ce tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.532549 Jun 15 14:43:31.314800 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 31/57] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 14:43:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 1563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:43:31.348625 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-fa324a6b-dbbb-42f2-a43f-160fd36ea709 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:31.355737 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-fa324a6b-dbbb-42f2-a43f-160fd36ea709 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:31.390470 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-37c38db9-dc26-448b-8419-04110d7b52d9 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:31.402011 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-37c38db9-dc26-448b-8419-04110d7b52d9 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1314 microversion: 2.1 time: 0.507672 Jun 15 14:43:31.403696 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 27/58] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:30 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:31.423042 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-649208a6-873c-4b3b-95e1-8a5c16edc2f7 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:31.432108 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-649208a6-873c-4b3b-95e1-8a5c16edc2f7 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:31.624424 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-649208a6-873c-4b3b-95e1-8a5c16edc2f7 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:31.642815 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-649208a6-873c-4b3b-95e1-8a5c16edc2f7 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1238 microversion: 2.1 time: 0.232811 Jun 15 14:43:31.643563 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 28/59] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:31 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1238 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:31.803270 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-fa324a6b-dbbb-42f2-a43f-160fd36ea709 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:31.830738 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-fa324a6b-dbbb-42f2-a43f-160fd36ea709 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1221 microversion: 2.1 time: 0.512859 Jun 15 14:43:31.833845 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 32/60] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:31 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1221 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:31.910349 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-37f8ae2e-5013-477a-898e-dd04af3b654e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:31.911026 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-37f8ae2e-5013-477a-898e-dd04af3b654e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:31.945504 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-37f8ae2e-5013-477a-898e-dd04af3b654e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:31.951400 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-37f8ae2e-5013-477a-898e-dd04af3b654e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:31.952389 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-37f8ae2e-5013-477a-898e-dd04af3b654e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:31.959305 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-37f8ae2e-5013-477a-898e-dd04af3b654e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:32.421985 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-5e8d1550-ac37-47ec-8d14-d624b5045937 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:32.422718 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-5e8d1550-ac37-47ec-8d14-d624b5045937 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:32.442496 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5e8d1550-ac37-47ec-8d14-d624b5045937 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:32.446233 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5e8d1550-ac37-47ec-8d14-d624b5045937 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:32.447205 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5e8d1550-ac37-47ec-8d14-d624b5045937 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:32.447765 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5e8d1550-ac37-47ec-8d14-d624b5045937 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:32.635763 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-37f8ae2e-5013-477a-898e-dd04af3b654e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:32.645399 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-37f8ae2e-5013-477a-898e-dd04af3b654e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:32.658613 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-37f8ae2e-5013-477a-898e-dd04af3b654e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:32.659781 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-37f8ae2e-5013-477a-898e-dd04af3b654e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1340 microversion: 2.20 time: 0.754659 Jun 15 14:43:32.668806 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 29/61] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:31 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1340 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:32.691332 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c9c267df-eb98-491f-ba68-043db520e58f tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:32.692460 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c9c267df-eb98-491f-ba68-043db520e58f tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:32.708235 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c9c267df-eb98-491f-ba68-043db520e58f tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:32.711225 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c9c267df-eb98-491f-ba68-043db520e58f tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:32.712226 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c9c267df-eb98-491f-ba68-043db520e58f tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:32.715469 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c9c267df-eb98-491f-ba68-043db520e58f tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:33.029009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-5e8d1550-ac37-47ec-8d14-d624b5045937 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:33.039210 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-5e8d1550-ac37-47ec-8d14-d624b5045937 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1314 microversion: 2.1 time: 0.622568 Jun 15 14:43:33.042407 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 33/62] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:32 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1314 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:33.053795 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c6033055-5f64-422b-8cf0-990b0f70cf03 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:33.054449 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-c6033055-5f64-422b-8cf0-990b0f70cf03 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:33.068412 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c6033055-5f64-422b-8cf0-990b0f70cf03 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:33.068864 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c6033055-5f64-422b-8cf0-990b0f70cf03 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:33.079978 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c9c267df-eb98-491f-ba68-043db520e58f tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:33.080125 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c6033055-5f64-422b-8cf0-990b0f70cf03 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:33.080789 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c6033055-5f64-422b-8cf0-990b0f70cf03 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:33.088369 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-c9c267df-eb98-491f-ba68-043db520e58f tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1242 microversion: 2.1 time: 0.417557 Jun 15 14:43:33.089636 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 30/63] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:32 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1242 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:33.620301 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-c6033055-5f64-422b-8cf0-990b0f70cf03 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:33.635018 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-c6033055-5f64-422b-8cf0-990b0f70cf03 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1273 microversion: 2.1 time: 0.590330 Jun 15 14:43:33.635897 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 34/64] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:33 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1273 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:33.678387 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-4b168354-9153-4977-9f29-2164f1bd3fcc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:33.679338 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-4b168354-9153-4977-9f29-2164f1bd3fcc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:33.686226 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4b168354-9153-4977-9f29-2164f1bd3fcc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:33.686682 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4b168354-9153-4977-9f29-2164f1bd3fcc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:33.687405 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4b168354-9153-4977-9f29-2164f1bd3fcc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:33.687848 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4b168354-9153-4977-9f29-2164f1bd3fcc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:33.768103 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-4b168354-9153-4977-9f29-2164f1bd3fcc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:33.780899 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-4b168354-9153-4977-9f29-2164f1bd3fcc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:33.788129 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-4b168354-9153-4977-9f29-2164f1bd3fcc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:33.790253 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-4b168354-9153-4977-9f29-2164f1bd3fcc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1338 microversion: 2.20 time: 0.114602 Jun 15 14:43:33.801631 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 31/65] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:33 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1338 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:34.058184 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a14dba6f-29ea-43f8-a72a-e5d94827176d tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:34.059359 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a14dba6f-29ea-43f8-a72a-e5d94827176d tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:34.068375 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a14dba6f-29ea-43f8-a72a-e5d94827176d tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:34.068986 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a14dba6f-29ea-43f8-a72a-e5d94827176d tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:34.069896 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a14dba6f-29ea-43f8-a72a-e5d94827176d tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:34.070335 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a14dba6f-29ea-43f8-a72a-e5d94827176d tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:34.114315 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-47ff9571-6047-4671-8e1a-42fa963ff5cd tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:34.114962 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-47ff9571-6047-4671-8e1a-42fa963ff5cd tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:34.133057 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-47ff9571-6047-4671-8e1a-42fa963ff5cd tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:34.133517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-47ff9571-6047-4671-8e1a-42fa963ff5cd tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:34.134329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-47ff9571-6047-4671-8e1a-42fa963ff5cd tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:34.134766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-47ff9571-6047-4671-8e1a-42fa963ff5cd tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:34.334254 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-47ff9571-6047-4671-8e1a-42fa963ff5cd tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:34.355604 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-47ff9571-6047-4671-8e1a-42fa963ff5cd tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1290 microversion: 2.1 time: 0.252952 Jun 15 14:43:34.365486 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 32/66] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:34 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1290 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:34.652645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-94a4a9e5-8c5b-4d1e-844e-83e907aa004f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:34.653353 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-94a4a9e5-8c5b-4d1e-844e-83e907aa004f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:34.665077 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-94a4a9e5-8c5b-4d1e-844e-83e907aa004f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:34.670572 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-94a4a9e5-8c5b-4d1e-844e-83e907aa004f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:34.673942 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-94a4a9e5-8c5b-4d1e-844e-83e907aa004f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:34.674565 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-94a4a9e5-8c5b-4d1e-844e-83e907aa004f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:34.967715 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-94a4a9e5-8c5b-4d1e-844e-83e907aa004f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:34.978455 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-94a4a9e5-8c5b-4d1e-844e-83e907aa004f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1279 microversion: 2.1 time: 0.329662 Jun 15 14:43:34.993321 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 33/67] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:34 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1279 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:35.010932 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-2e96eff9-ca32-442e-bf55-cb497788fb71 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:35.012167 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-2e96eff9-ca32-442e-bf55-cb497788fb71 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:35.027510 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2e96eff9-ca32-442e-bf55-cb497788fb71 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:35.028327 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2e96eff9-ca32-442e-bf55-cb497788fb71 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:35.029831 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2e96eff9-ca32-442e-bf55-cb497788fb71 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:35.030429 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2e96eff9-ca32-442e-bf55-cb497788fb71 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:35.101981 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a14dba6f-29ea-43f8-a72a-e5d94827176d tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:35.116498 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a14dba6f-29ea-43f8-a72a-e5d94827176d tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1314 microversion: 2.1 time: 1.062113 Jun 15 14:43:35.128267 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 35/68] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:34 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1314 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:35.165609 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-2e96eff9-ca32-442e-bf55-cb497788fb71 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:35.179835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-2e96eff9-ca32-442e-bf55-cb497788fb71 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:35.181587 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-2e96eff9-ca32-442e-bf55-cb497788fb71 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:35.183515 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-2e96eff9-ca32-442e-bf55-cb497788fb71 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1338 microversion: 2.20 time: 0.188800 Jun 15 14:43:35.184261 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 34/69] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:34 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1338 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:35.376647 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-2e856263-35e0-4354-8b2b-65f8466b03ca tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:35.378747 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-2e856263-35e0-4354-8b2b-65f8466b03ca tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:35.391567 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2e856263-35e0-4354-8b2b-65f8466b03ca tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:35.392350 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2e856263-35e0-4354-8b2b-65f8466b03ca tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:35.393718 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2e856263-35e0-4354-8b2b-65f8466b03ca tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:35.394674 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2e856263-35e0-4354-8b2b-65f8466b03ca tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:35.523709 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-2e856263-35e0-4354-8b2b-65f8466b03ca tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:35.538456 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-2e856263-35e0-4354-8b2b-65f8466b03ca tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1296 microversion: 2.1 time: 0.167365 Jun 15 14:43:35.541538 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 36/70] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:35 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1296 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:35.999341 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-60e014d5-22c9-4041-b0fd-032ab3989291 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:35.999962 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-60e014d5-22c9-4041-b0fd-032ab3989291 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:36.013893 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-60e014d5-22c9-4041-b0fd-032ab3989291 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:36.014462 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-60e014d5-22c9-4041-b0fd-032ab3989291 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:36.015394 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-60e014d5-22c9-4041-b0fd-032ab3989291 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:36.015791 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-60e014d5-22c9-4041-b0fd-032ab3989291 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:36.134835 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-7db2b083-e3c7-4b84-8836-b9cb7da9b17b tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:36.135507 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-7db2b083-e3c7-4b84-8836-b9cb7da9b17b tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:36.145035 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7db2b083-e3c7-4b84-8836-b9cb7da9b17b tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:36.145493 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7db2b083-e3c7-4b84-8836-b9cb7da9b17b tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:36.146330 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7db2b083-e3c7-4b84-8836-b9cb7da9b17b tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:36.152723 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7db2b083-e3c7-4b84-8836-b9cb7da9b17b tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:36.215317 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-60e014d5-22c9-4041-b0fd-032ab3989291 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:36.226530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-60e014d5-22c9-4041-b0fd-032ab3989291 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1279 microversion: 2.1 time: 0.231413 Jun 15 14:43:36.237068 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 35/71] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:35 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1279 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:36.242336 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-cae17501-9182-45ac-b250-3964f6f732b8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:36.244517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-cae17501-9182-45ac-b250-3964f6f732b8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:36.266589 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-cae17501-9182-45ac-b250-3964f6f732b8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:36.267068 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-cae17501-9182-45ac-b250-3964f6f732b8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:36.269591 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-cae17501-9182-45ac-b250-3964f6f732b8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:36.270199 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-cae17501-9182-45ac-b250-3964f6f732b8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:36.424641 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-7db2b083-e3c7-4b84-8836-b9cb7da9b17b tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:36.432137 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-7db2b083-e3c7-4b84-8836-b9cb7da9b17b tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1314 microversion: 2.1 time: 0.301727 Jun 15 14:43:36.432717 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 37/72] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:36 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:36.560578 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-4205ea22-81a0-4303-af65-a1fae22095bb tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:36.562332 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-4205ea22-81a0-4303-af65-a1fae22095bb tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:36.575056 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4205ea22-81a0-4303-af65-a1fae22095bb tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:36.576158 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4205ea22-81a0-4303-af65-a1fae22095bb tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:36.579919 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4205ea22-81a0-4303-af65-a1fae22095bb tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:36.580589 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4205ea22-81a0-4303-af65-a1fae22095bb tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:36.678125 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-cae17501-9182-45ac-b250-3964f6f732b8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:36.703662 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-cae17501-9182-45ac-b250-3964f6f732b8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:36.705573 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-cae17501-9182-45ac-b250-3964f6f732b8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:36.708851 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-cae17501-9182-45ac-b250-3964f6f732b8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.470974 Jun 15 14:43:36.723455 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 36/73] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:36 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:36.985889 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-4205ea22-81a0-4303-af65-a1fae22095bb tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:37.005224 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-4205ea22-81a0-4303-af65-a1fae22095bb tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1363 microversion: 2.1 time: 0.440688 Jun 15 14:43:37.018027 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 38/74] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:36 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1363 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:37.245957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-700f20d3-8ea0-444a-be4f-ea3c21be84dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:37.246730 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-700f20d3-8ea0-444a-be4f-ea3c21be84dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:37.255162 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-700f20d3-8ea0-444a-be4f-ea3c21be84dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:37.255758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-700f20d3-8ea0-444a-be4f-ea3c21be84dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:37.256660 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-700f20d3-8ea0-444a-be4f-ea3c21be84dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:37.257180 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-700f20d3-8ea0-444a-be4f-ea3c21be84dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:37.418017 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-700f20d3-8ea0-444a-be4f-ea3c21be84dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:37.427122 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-700f20d3-8ea0-444a-be4f-ea3c21be84dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.186494 Jun 15 14:43:37.428098 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 37/75] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:37 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:37.454148 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-16d8d7c4-6039-444d-9666-48e325a320c3 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:37.455564 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-16d8d7c4-6039-444d-9666-48e325a320c3 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:37.463555 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-16d8d7c4-6039-444d-9666-48e325a320c3 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:37.464243 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-16d8d7c4-6039-444d-9666-48e325a320c3 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:37.465226 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-16d8d7c4-6039-444d-9666-48e325a320c3 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:37.466009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-16d8d7c4-6039-444d-9666-48e325a320c3 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:37.614282 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-16d8d7c4-6039-444d-9666-48e325a320c3 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:37.623470 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-16d8d7c4-6039-444d-9666-48e325a320c3 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1314 microversion: 2.1 time: 0.175259 Jun 15 14:43:37.624199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 39/76] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:37 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:37.729259 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-775a7eec-5d2f-44d1-a036-493835e9c887 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:37.729898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-775a7eec-5d2f-44d1-a036-493835e9c887 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:37.736512 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-775a7eec-5d2f-44d1-a036-493835e9c887 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:37.737000 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-775a7eec-5d2f-44d1-a036-493835e9c887 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:37.737749 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-775a7eec-5d2f-44d1-a036-493835e9c887 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:37.738209 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-775a7eec-5d2f-44d1-a036-493835e9c887 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:37.886148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-775a7eec-5d2f-44d1-a036-493835e9c887 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:37.897622 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-775a7eec-5d2f-44d1-a036-493835e9c887 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:37.900169 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-775a7eec-5d2f-44d1-a036-493835e9c887 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:37.901553 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-775a7eec-5d2f-44d1-a036-493835e9c887 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.176117 Jun 15 14:43:37.902859 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 38/77] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:37 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:38.029975 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-68a035da-9246-4aae-8c31-3de6f4e46d0c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:38.030878 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-68a035da-9246-4aae-8c31-3de6f4e46d0c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:38.039985 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-68a035da-9246-4aae-8c31-3de6f4e46d0c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:38.040616 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-68a035da-9246-4aae-8c31-3de6f4e46d0c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:38.041822 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-68a035da-9246-4aae-8c31-3de6f4e46d0c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:38.043740 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-68a035da-9246-4aae-8c31-3de6f4e46d0c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:38.448714 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c8b497c7-42b9-43ae-9fdb-63e3b76682ff tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:38.449984 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c8b497c7-42b9-43ae-9fdb-63e3b76682ff tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:38.462821 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c8b497c7-42b9-43ae-9fdb-63e3b76682ff tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:38.463493 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c8b497c7-42b9-43ae-9fdb-63e3b76682ff tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:38.464358 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c8b497c7-42b9-43ae-9fdb-63e3b76682ff tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:38.465323 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c8b497c7-42b9-43ae-9fdb-63e3b76682ff tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:38.633147 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-68a035da-9246-4aae-8c31-3de6f4e46d0c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:38.649907 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-68a035da-9246-4aae-8c31-3de6f4e46d0c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1363 microversion: 2.1 time: 0.626896 Jun 15 14:43:38.650753 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 40/78] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:38 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1363 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:38.660368 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1e6a3392-f05a-42ee-b57f-751f8cca7c22 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:38.661175 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1e6a3392-f05a-42ee-b57f-751f8cca7c22 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:38.681751 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1e6a3392-f05a-42ee-b57f-751f8cca7c22 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:38.682226 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1e6a3392-f05a-42ee-b57f-751f8cca7c22 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:38.683026 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1e6a3392-f05a-42ee-b57f-751f8cca7c22 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:38.683469 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1e6a3392-f05a-42ee-b57f-751f8cca7c22 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:38.898610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c8b497c7-42b9-43ae-9fdb-63e3b76682ff tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:38.906879 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-c8b497c7-42b9-43ae-9fdb-63e3b76682ff tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.465662 Jun 15 14:43:38.916748 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 39/79] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:38 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:38.924221 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f64dfb51-780a-422d-8bf1-7bdf2db4135e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:38.925299 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f64dfb51-780a-422d-8bf1-7bdf2db4135e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:38.936221 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f64dfb51-780a-422d-8bf1-7bdf2db4135e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:38.937296 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f64dfb51-780a-422d-8bf1-7bdf2db4135e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:38.939105 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f64dfb51-780a-422d-8bf1-7bdf2db4135e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:38.939629 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f64dfb51-780a-422d-8bf1-7bdf2db4135e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:39.207439 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f64dfb51-780a-422d-8bf1-7bdf2db4135e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:39.219400 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f64dfb51-780a-422d-8bf1-7bdf2db4135e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:39.224979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f64dfb51-780a-422d-8bf1-7bdf2db4135e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:39.226428 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f64dfb51-780a-422d-8bf1-7bdf2db4135e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.308451 Jun 15 14:43:39.227941 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 40/80] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:38 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:39.235484 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-409108f7-2ee9-4d24-8e67-1add9c021baf req-a44418c9-91e2-4abb-b07c-ddc0a4651a1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "401c9feb-30ca-4df6-9fba-0a05da5dce7b", "tag": "fb5c9876-5726-466e-a543-a3f84f0df112"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:39.251654 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-409108f7-2ee9-4d24-8e67-1add9c021baf req-a44418c9-91e2-4abb-b07c-ddc0a4651a1d service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:39.252593 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-409108f7-2ee9-4d24-8e67-1add9c021baf req-a44418c9-91e2-4abb-b07c-ddc0a4651a1d service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:39.277641 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-409108f7-2ee9-4d24-8e67-1add9c021baf req-a44418c9-91e2-4abb-b07c-ddc0a4651a1d service nova] Creating event network-changed:fb5c9876-5726-466e-a543-a3f84f0df112 for instance 401c9feb-30ca-4df6-9fba-0a05da5dce7b on hv-cinder-84327 Jun 15 14:43:39.277865 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-1e6a3392-f05a-42ee-b57f-751f8cca7c22 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:39.290642 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-1e6a3392-f05a-42ee-b57f-751f8cca7c22 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1314 microversion: 2.1 time: 0.638546 Jun 15 14:43:39.291254 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 41/81] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:38 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:39.302913 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-409108f7-2ee9-4d24-8e67-1add9c021baf req-a44418c9-91e2-4abb-b07c-ddc0a4651a1d service nova] Acquired lock "compute-rpcapi-router" {{(pid=124219) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 15 14:43:39.304301 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-87888312-08d3-4722-9bd3-d0f34453f4c9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:39.304914 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-87888312-08d3-4722-9bd3-d0f34453f4c9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:39.305742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-87888312-08d3-4722-9bd3-d0f34453f4c9 None None] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:39.306224 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-87888312-08d3-4722-9bd3-d0f34453f4c9 None None] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:39.316825 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.compute.rpcapi [None req-87888312-08d3-4722-9bd3-d0f34453f4c9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 15 14:43:39.318030 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-87888312-08d3-4722-9bd3-d0f34453f4c9 None None] Releasing lock "compute-rpcapi-router" {{(pid=124219) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 15 14:43:39.336735 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-87888312-08d3-4722-9bd3-d0f34453f4c9 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105221 Jun 15 14:43:39.337475 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 41/82] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:39.669255 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-5ca38ec6-2bcc-409c-a988-5598c3ac9b85 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:39.671441 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-5ca38ec6-2bcc-409c-a988-5598c3ac9b85 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:39.688882 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5ca38ec6-2bcc-409c-a988-5598c3ac9b85 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:39.689258 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5ca38ec6-2bcc-409c-a988-5598c3ac9b85 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:39.690966 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5ca38ec6-2bcc-409c-a988-5598c3ac9b85 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:39.691410 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5ca38ec6-2bcc-409c-a988-5598c3ac9b85 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:39.926963 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f8f526d3-e2ad-47c8-b896-503e2265a80f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:39.928593 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f8f526d3-e2ad-47c8-b896-503e2265a80f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:39.940644 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f8f526d3-e2ad-47c8-b896-503e2265a80f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:39.942368 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f8f526d3-e2ad-47c8-b896-503e2265a80f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:39.943980 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f8f526d3-e2ad-47c8-b896-503e2265a80f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:39.944543 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f8f526d3-e2ad-47c8-b896-503e2265a80f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:40.212646 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f8f526d3-e2ad-47c8-b896-503e2265a80f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:40.222558 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f8f526d3-e2ad-47c8-b896-503e2265a80f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.301216 Jun 15 14:43:40.223407 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 42/83] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:39 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:40.253983 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-ae649f3c-8fe1-48e5-959f-c60a43a16af3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:40.254771 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-ae649f3c-8fe1-48e5-959f-c60a43a16af3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:40.263598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ae649f3c-8fe1-48e5-959f-c60a43a16af3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:40.264692 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ae649f3c-8fe1-48e5-959f-c60a43a16af3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:40.265924 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ae649f3c-8fe1-48e5-959f-c60a43a16af3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:40.266596 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ae649f3c-8fe1-48e5-959f-c60a43a16af3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:40.485819 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-ae649f3c-8fe1-48e5-959f-c60a43a16af3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:40.493279 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=100 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:40.502789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-ae649f3c-8fe1-48e5-959f-c60a43a16af3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:40.504325 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-ae649f3c-8fe1-48e5-959f-c60a43a16af3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:40.508395 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-ae649f3c-8fe1-48e5-959f-c60a43a16af3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.263769 Jun 15 14:43:40.511137 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 43/84] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:40 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:43:40.518609 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-d5ebf200-e801-4102-b86a-7cbca0f82bd6 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:40.519240 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-d5ebf200-e801-4102-b86a-7cbca0f82bd6 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:40.525971 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d5ebf200-e801-4102-b86a-7cbca0f82bd6 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:40.526627 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d5ebf200-e801-4102-b86a-7cbca0f82bd6 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:40.527735 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d5ebf200-e801-4102-b86a-7cbca0f82bd6 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:40.528320 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d5ebf200-e801-4102-b86a-7cbca0f82bd6 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:40.672462 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-5ca38ec6-2bcc-409c-a988-5598c3ac9b85 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:40.690274 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-5ca38ec6-2bcc-409c-a988-5598c3ac9b85 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1363 microversion: 2.1 time: 1.026400 Jun 15 14:43:40.695373 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 42/85] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:39 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1363 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:40.752870 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d5ebf200-e801-4102-b86a-7cbca0f82bd6 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:40.765273 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-d5ebf200-e801-4102-b86a-7cbca0f82bd6 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1314 microversion: 2.1 time: 0.252653 Jun 15 14:43:40.774807 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 44/86] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:40 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:41.063671 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=6 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:41.165284 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-d3052680-4434-42cf-a4b2-7f6dc6f4253a req-cfa6beb9-f031-4e0b-8288-b17333823b84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "123ea48b-cb21-429c-85c6-0ae71d51c1c0", "tag": "3b30c106-589d-4777-be4f-8c3b882d514e"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:41.182213 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-d3052680-4434-42cf-a4b2-7f6dc6f4253a req-cfa6beb9-f031-4e0b-8288-b17333823b84 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:41.182813 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-d3052680-4434-42cf-a4b2-7f6dc6f4253a req-cfa6beb9-f031-4e0b-8288-b17333823b84 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:41.187403 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=100 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:41.212935 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-d3052680-4434-42cf-a4b2-7f6dc6f4253a req-cfa6beb9-f031-4e0b-8288-b17333823b84 service nova] Creating event network-changed:3b30c106-589d-4777-be4f-8c3b882d514e for instance 123ea48b-cb21-429c-85c6-0ae71d51c1c0 on hv-cinder-84327 Jun 15 14:43:41.218090 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-d3052680-4434-42cf-a4b2-7f6dc6f4253a req-cfa6beb9-f031-4e0b-8288-b17333823b84 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156391 Jun 15 14:43:41.218699 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 43/87] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:41.240731 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-277425c4-de91-4292-af0d-5a6dfc8377f4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:41.241358 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-277425c4-de91-4292-af0d-5a6dfc8377f4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:41.249125 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-277425c4-de91-4292-af0d-5a6dfc8377f4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:41.249527 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-277425c4-de91-4292-af0d-5a6dfc8377f4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:41.250343 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-277425c4-de91-4292-af0d-5a6dfc8377f4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:41.251936 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-277425c4-de91-4292-af0d-5a6dfc8377f4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:41.468042 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-277425c4-de91-4292-af0d-5a6dfc8377f4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:41.477051 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-277425c4-de91-4292-af0d-5a6dfc8377f4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.240287 Jun 15 14:43:41.478059 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 45/88] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:41 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:41.529806 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1c307749-5e11-4394-a043-2856b1d32d2d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:41.530827 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1c307749-5e11-4394-a043-2856b1d32d2d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:41.537534 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1c307749-5e11-4394-a043-2856b1d32d2d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:41.538107 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1c307749-5e11-4394-a043-2856b1d32d2d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:41.539003 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1c307749-5e11-4394-a043-2856b1d32d2d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:41.539510 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1c307749-5e11-4394-a043-2856b1d32d2d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:41.708746 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=22 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:41.730688 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-1c307749-5e11-4394-a043-2856b1d32d2d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:41.738930 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-1c307749-5e11-4394-a043-2856b1d32d2d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:41.740446 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-1c307749-5e11-4394-a043-2856b1d32d2d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:41.741551 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-1c307749-5e11-4394-a043-2856b1d32d2d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.217027 Jun 15 14:43:41.751859 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 44/89] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:41 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:41.756538 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-5ea946d1-f827-44d6-947b-a9577bdd85a3 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:41.757304 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-5ea946d1-f827-44d6-947b-a9577bdd85a3 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:41.765441 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-39d34f9f-49f5-4408-8e04-ec200209ec6f req-1153e5d3-2730-4a0a-bfee-608611634a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c1ec95-3f54-48c5-99d2-004d76ceed87", "name": "network-vif-plugged", "status": "completed", "tag": "d3e3b078-39b7-46d0-885a-6c877f026556"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:41.767911 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5ea946d1-f827-44d6-947b-a9577bdd85a3 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:41.768604 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5ea946d1-f827-44d6-947b-a9577bdd85a3 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:41.769624 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5ea946d1-f827-44d6-947b-a9577bdd85a3 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:41.770312 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5ea946d1-f827-44d6-947b-a9577bdd85a3 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:41.773568 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-39d34f9f-49f5-4408-8e04-ec200209ec6f req-1153e5d3-2730-4a0a-bfee-608611634a03 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:41.774042 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-39d34f9f-49f5-4408-8e04-ec200209ec6f req-1153e5d3-2730-4a0a-bfee-608611634a03 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:41.787095 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-39d34f9f-49f5-4408-8e04-ec200209ec6f req-1153e5d3-2730-4a0a-bfee-608611634a03 service nova] Creating event network-vif-plugged:d3e3b078-39b7-46d0-885a-6c877f026556 for instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 on hv-cinder-84327 Jun 15 14:43:41.792053 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-39d34f9f-49f5-4408-8e04-ec200209ec6f req-1153e5d3-2730-4a0a-bfee-608611634a03 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088346 Jun 15 14:43:41.792640 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 46/90] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:43:41.799562 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f18f49cb-cfcc-4fe9-8bdc-57d5f2d72683 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:41.800304 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f18f49cb-cfcc-4fe9-8bdc-57d5f2d72683 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:41.808748 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f18f49cb-cfcc-4fe9-8bdc-57d5f2d72683 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:41.809587 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f18f49cb-cfcc-4fe9-8bdc-57d5f2d72683 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:41.811660 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f18f49cb-cfcc-4fe9-8bdc-57d5f2d72683 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:41.812506 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f18f49cb-cfcc-4fe9-8bdc-57d5f2d72683 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:41.829120 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=14 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:41.915449 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-5ea946d1-f827-44d6-947b-a9577bdd85a3 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:41.926471 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-5ea946d1-f827-44d6-947b-a9577bdd85a3 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1363 microversion: 2.1 time: 0.173203 Jun 15 14:43:41.927661 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 45/91] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:41 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:41.964278 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f18f49cb-cfcc-4fe9-8bdc-57d5f2d72683 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:41.973892 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f18f49cb-cfcc-4fe9-8bdc-57d5f2d72683 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1314 microversion: 2.1 time: 0.179748 Jun 15 14:43:41.974402 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 47/92] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:41 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:42.494006 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-407f5bfd-daad-499f-aca7-fbac49caf6a3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:42.494541 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-407f5bfd-daad-499f-aca7-fbac49caf6a3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:42.501491 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-407f5bfd-daad-499f-aca7-fbac49caf6a3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:42.502065 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-407f5bfd-daad-499f-aca7-fbac49caf6a3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:42.502907 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-407f5bfd-daad-499f-aca7-fbac49caf6a3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:42.503347 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-407f5bfd-daad-499f-aca7-fbac49caf6a3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:42.643321 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-407f5bfd-daad-499f-aca7-fbac49caf6a3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:42.651089 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-407f5bfd-daad-499f-aca7-fbac49caf6a3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.161090 Jun 15 14:43:42.651986 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 46/93] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:42 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:42.759292 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-34f71ecc-dc0f-4c50-ad4d-f91ab2e502c7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:42.760769 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-34f71ecc-dc0f-4c50-ad4d-f91ab2e502c7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:42.768504 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-34f71ecc-dc0f-4c50-ad4d-f91ab2e502c7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:42.769163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-34f71ecc-dc0f-4c50-ad4d-f91ab2e502c7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:42.770249 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-34f71ecc-dc0f-4c50-ad4d-f91ab2e502c7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:42.770869 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-34f71ecc-dc0f-4c50-ad4d-f91ab2e502c7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:42.907490 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-34f71ecc-dc0f-4c50-ad4d-f91ab2e502c7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:42.915307 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-34f71ecc-dc0f-4c50-ad4d-f91ab2e502c7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:42.916835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-34f71ecc-dc0f-4c50-ad4d-f91ab2e502c7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:42.917951 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-34f71ecc-dc0f-4c50-ad4d-f91ab2e502c7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.162791 Jun 15 14:43:42.918497 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 48/94] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:42 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:42.943946 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a041b1fa-1112-4f07-b91d-c01552259ab4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:42.944564 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a041b1fa-1112-4f07-b91d-c01552259ab4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:42.946440 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:42.951731 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a041b1fa-1112-4f07-b91d-c01552259ab4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:42.952181 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a041b1fa-1112-4f07-b91d-c01552259ab4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:42.952939 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a041b1fa-1112-4f07-b91d-c01552259ab4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:42.953390 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a041b1fa-1112-4f07-b91d-c01552259ab4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:42.991573 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f800523d-db4e-413c-a26e-0acfc29b8ef5 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:42.992092 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f800523d-db4e-413c-a26e-0acfc29b8ef5 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:42.998168 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f800523d-db4e-413c-a26e-0acfc29b8ef5 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:42.998612 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f800523d-db4e-413c-a26e-0acfc29b8ef5 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:42.999367 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f800523d-db4e-413c-a26e-0acfc29b8ef5 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:42.999794 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f800523d-db4e-413c-a26e-0acfc29b8ef5 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:43.085196 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a041b1fa-1112-4f07-b91d-c01552259ab4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:43.093884 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a041b1fa-1112-4f07-b91d-c01552259ab4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1363 microversion: 2.1 time: 0.153727 Jun 15 14:43:43.094464 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 47/95] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:42 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:43.131569 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f800523d-db4e-413c-a26e-0acfc29b8ef5 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:43.139403 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f800523d-db4e-413c-a26e-0acfc29b8ef5 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1314 microversion: 2.1 time: 0.151733 Jun 15 14:43:43.139991 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 49/96] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:42 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:43.236063 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-7a12cb85-bd91-4f2e-a1fc-3fedbd8b976d req-a68ddf61-d810-47df-87ca-b0298c85c602 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "373c3c82-91e0-4d91-8933-c2dbe3582fee", "tag": "ddfa8e08-5c5d-4799-9986-83a3e2b1e12e"}, {"name": "network-changed", "server_uuid": "24657b06-5ef6-429a-bce1-db0da36fea71", "tag": "31dbb14f-e111-495f-87c5-4ba2c1afb4a7"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:43.245222 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-7a12cb85-bd91-4f2e-a1fc-3fedbd8b976d req-a68ddf61-d810-47df-87ca-b0298c85c602 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:43.245684 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-7a12cb85-bd91-4f2e-a1fc-3fedbd8b976d req-a68ddf61-d810-47df-87ca-b0298c85c602 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:43.258115 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-7a12cb85-bd91-4f2e-a1fc-3fedbd8b976d req-a68ddf61-d810-47df-87ca-b0298c85c602 service nova] Creating event network-changed:ddfa8e08-5c5d-4799-9986-83a3e2b1e12e for instance 373c3c82-91e0-4d91-8933-c2dbe3582fee on hv-cinder-84327 Jun 15 14:43:43.258616 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-7a12cb85-bd91-4f2e-a1fc-3fedbd8b976d req-a68ddf61-d810-47df-87ca-b0298c85c602 service nova] Creating event network-changed:31dbb14f-e111-495f-87c5-4ba2c1afb4a7 for instance 24657b06-5ef6-429a-bce1-db0da36fea71 on hv-cinder-84327 Jun 15 14:43:43.267360 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-7a12cb85-bd91-4f2e-a1fc-3fedbd8b976d req-a68ddf61-d810-47df-87ca-b0298c85c602 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034996 Jun 15 14:43:43.267983 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 48/97] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:43.668875 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-1a4a6a5c-2b0e-4ae7-8884-96322f5be094 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:43.670779 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-1a4a6a5c-2b0e-4ae7-8884-96322f5be094 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:43.676955 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1a4a6a5c-2b0e-4ae7-8884-96322f5be094 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:43.677397 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1a4a6a5c-2b0e-4ae7-8884-96322f5be094 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:43.678207 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1a4a6a5c-2b0e-4ae7-8884-96322f5be094 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:43.678636 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1a4a6a5c-2b0e-4ae7-8884-96322f5be094 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:43.806074 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-1a4a6a5c-2b0e-4ae7-8884-96322f5be094 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:43.814902 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-1a4a6a5c-2b0e-4ae7-8884-96322f5be094 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.150470 Jun 15 14:43:43.815468 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 50/98] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:43 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:43.937606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-437374a6-0ae1-48f3-a1f8-aac8b2baa514 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:43.938325 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-437374a6-0ae1-48f3-a1f8-aac8b2baa514 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:43.944469 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-437374a6-0ae1-48f3-a1f8-aac8b2baa514 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:43.945002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-437374a6-0ae1-48f3-a1f8-aac8b2baa514 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:43.945648 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-437374a6-0ae1-48f3-a1f8-aac8b2baa514 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:43.946112 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-437374a6-0ae1-48f3-a1f8-aac8b2baa514 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:44.077936 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-437374a6-0ae1-48f3-a1f8-aac8b2baa514 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:44.086047 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-437374a6-0ae1-48f3-a1f8-aac8b2baa514 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:44.087550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-437374a6-0ae1-48f3-a1f8-aac8b2baa514 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:44.088651 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-437374a6-0ae1-48f3-a1f8-aac8b2baa514 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.155770 Jun 15 14:43:44.089206 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 49/99] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:43 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:44.110577 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-d5c38415-fa31-40ee-9feb-d1c1d31015f0 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:44.111192 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-d5c38415-fa31-40ee-9feb-d1c1d31015f0 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:44.117044 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d5c38415-fa31-40ee-9feb-d1c1d31015f0 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:44.117499 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d5c38415-fa31-40ee-9feb-d1c1d31015f0 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:44.118298 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d5c38415-fa31-40ee-9feb-d1c1d31015f0 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:44.118735 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d5c38415-fa31-40ee-9feb-d1c1d31015f0 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:44.156287 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-18211469-1f94-40d5-8710-a816257d2fe9 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:44.156900 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-18211469-1f94-40d5-8710-a816257d2fe9 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:44.162975 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-18211469-1f94-40d5-8710-a816257d2fe9 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:44.163417 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-18211469-1f94-40d5-8710-a816257d2fe9 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:44.164188 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-18211469-1f94-40d5-8710-a816257d2fe9 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:44.164623 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-18211469-1f94-40d5-8710-a816257d2fe9 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:44.254715 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d5c38415-fa31-40ee-9feb-d1c1d31015f0 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:44.263296 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-d5c38415-fa31-40ee-9feb-d1c1d31015f0 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1363 microversion: 2.1 time: 0.156376 Jun 15 14:43:44.264787 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 51/100] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:44 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:44.308844 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-18211469-1f94-40d5-8710-a816257d2fe9 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:44.316987 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-18211469-1f94-40d5-8710-a816257d2fe9 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1314 microversion: 2.1 time: 0.164515 Jun 15 14:43:44.317554 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 50/101] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:44 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:44.832407 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-961cb041-c1df-4404-ba61-eb2c93553104 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:44.833015 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-961cb041-c1df-4404-ba61-eb2c93553104 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:44.839370 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-961cb041-c1df-4404-ba61-eb2c93553104 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:44.839812 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-961cb041-c1df-4404-ba61-eb2c93553104 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:44.840567 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-961cb041-c1df-4404-ba61-eb2c93553104 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:44.841005 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-961cb041-c1df-4404-ba61-eb2c93553104 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:44.968039 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-961cb041-c1df-4404-ba61-eb2c93553104 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:44.975827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-961cb041-c1df-4404-ba61-eb2c93553104 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.147218 Jun 15 14:43:44.976390 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 52/102] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:44 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:45.107199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-5dbd643c-bbc1-4bcc-be22-f6a9e77c1677 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:45.107813 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-5dbd643c-bbc1-4bcc-be22-f6a9e77c1677 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:45.113881 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5dbd643c-bbc1-4bcc-be22-f6a9e77c1677 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:45.114335 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5dbd643c-bbc1-4bcc-be22-f6a9e77c1677 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:45.115121 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5dbd643c-bbc1-4bcc-be22-f6a9e77c1677 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:45.115541 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5dbd643c-bbc1-4bcc-be22-f6a9e77c1677 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:45.241773 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-5dbd643c-bbc1-4bcc-be22-f6a9e77c1677 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:45.250642 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-5dbd643c-bbc1-4bcc-be22-f6a9e77c1677 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:45.252053 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-5dbd643c-bbc1-4bcc-be22-f6a9e77c1677 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:45.253171 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-5dbd643c-bbc1-4bcc-be22-f6a9e77c1677 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.149950 Jun 15 14:43:45.253741 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 51/103] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:45 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:45.282845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-455daa53-1957-427c-ae12-b424467805fc tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:45.283731 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-455daa53-1957-427c-ae12-b424467805fc tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:45.289966 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-455daa53-1957-427c-ae12-b424467805fc tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:45.290416 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-455daa53-1957-427c-ae12-b424467805fc tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:45.291178 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-455daa53-1957-427c-ae12-b424467805fc tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:45.291613 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-455daa53-1957-427c-ae12-b424467805fc tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:45.334417 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-9a05a05f-2d6a-42b7-a2c6-8eb74b946e35 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:45.335037 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-9a05a05f-2d6a-42b7-a2c6-8eb74b946e35 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:45.341166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9a05a05f-2d6a-42b7-a2c6-8eb74b946e35 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:45.341624 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9a05a05f-2d6a-42b7-a2c6-8eb74b946e35 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:45.342428 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9a05a05f-2d6a-42b7-a2c6-8eb74b946e35 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:45.342869 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9a05a05f-2d6a-42b7-a2c6-8eb74b946e35 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:45.430714 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-455daa53-1957-427c-ae12-b424467805fc tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:45.439119 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-455daa53-1957-427c-ae12-b424467805fc tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1363 microversion: 2.1 time: 0.161759 Jun 15 14:43:45.439702 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 53/104] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:45 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:45.475272 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9a05a05f-2d6a-42b7-a2c6-8eb74b946e35 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:45.483375 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-9a05a05f-2d6a-42b7-a2c6-8eb74b946e35 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1314 microversion: 2.1 time: 0.152570 Jun 15 14:43:45.483879 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 52/105] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:45 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:45.992138 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-1a00590d-9760-4371-9cd7-ffabff4e17d3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:45.992751 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-1a00590d-9760-4371-9cd7-ffabff4e17d3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:45.998877 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1a00590d-9760-4371-9cd7-ffabff4e17d3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:45.999327 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1a00590d-9760-4371-9cd7-ffabff4e17d3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:46.000084 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1a00590d-9760-4371-9cd7-ffabff4e17d3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:46.000519 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1a00590d-9760-4371-9cd7-ffabff4e17d3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:46.128426 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-1a00590d-9760-4371-9cd7-ffabff4e17d3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:46.135806 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-1a00590d-9760-4371-9cd7-ffabff4e17d3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.147493 Jun 15 14:43:46.136360 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 54/106] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:45 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:46.270402 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6ba787a0-e901-4798-864d-e54f7636a067 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:46.271012 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6ba787a0-e901-4798-864d-e54f7636a067 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:46.277713 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6ba787a0-e901-4798-864d-e54f7636a067 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:46.278339 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6ba787a0-e901-4798-864d-e54f7636a067 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:46.279601 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6ba787a0-e901-4798-864d-e54f7636a067 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:46.280075 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6ba787a0-e901-4798-864d-e54f7636a067 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:46.425737 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6ba787a0-e901-4798-864d-e54f7636a067 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:46.434888 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6ba787a0-e901-4798-864d-e54f7636a067 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:46.437312 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6ba787a0-e901-4798-864d-e54f7636a067 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:46.438785 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-6ba787a0-e901-4798-864d-e54f7636a067 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.172196 Jun 15 14:43:46.439351 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 53/107] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:46 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:46.459986 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e9813de6-b0ec-4e34-b2be-4665706a9e87 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:46.461022 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-e9813de6-b0ec-4e34-b2be-4665706a9e87 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:46.467592 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e9813de6-b0ec-4e34-b2be-4665706a9e87 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:46.468047 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e9813de6-b0ec-4e34-b2be-4665706a9e87 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:46.468821 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e9813de6-b0ec-4e34-b2be-4665706a9e87 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:46.469257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e9813de6-b0ec-4e34-b2be-4665706a9e87 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:46.500646 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-681a608c-c5af-42c5-bceb-0a92441cf03e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:46.501344 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-681a608c-c5af-42c5-bceb-0a92441cf03e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:46.509792 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-681a608c-c5af-42c5-bceb-0a92441cf03e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:46.510336 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-681a608c-c5af-42c5-bceb-0a92441cf03e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:46.511210 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-681a608c-c5af-42c5-bceb-0a92441cf03e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:46.511948 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-681a608c-c5af-42c5-bceb-0a92441cf03e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:46.602422 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e9813de6-b0ec-4e34-b2be-4665706a9e87 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:46.610020 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-e9813de6-b0ec-4e34-b2be-4665706a9e87 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1363 microversion: 2.1 time: 0.154452 Jun 15 14:43:46.610593 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 55/108] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:46 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:46.648939 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-681a608c-c5af-42c5-bceb-0a92441cf03e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:46.656398 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-681a608c-c5af-42c5-bceb-0a92441cf03e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1314 microversion: 2.1 time: 0.160531 Jun 15 14:43:46.656961 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 54/109] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:46 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:47.152397 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-62666a6e-07f5-4180-9026-229cd03c2926 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:47.152941 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-62666a6e-07f5-4180-9026-229cd03c2926 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:47.159397 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-62666a6e-07f5-4180-9026-229cd03c2926 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:47.159858 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-62666a6e-07f5-4180-9026-229cd03c2926 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:47.160616 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-62666a6e-07f5-4180-9026-229cd03c2926 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:47.161050 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-62666a6e-07f5-4180-9026-229cd03c2926 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:47.290300 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-62666a6e-07f5-4180-9026-229cd03c2926 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:47.298406 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-62666a6e-07f5-4180-9026-229cd03c2926 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.149886 Jun 15 14:43:47.298965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 56/110] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:47 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:47.456352 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-21ba763d-c924-4958-84ee-ec29b3d147f0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:47.456967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-21ba763d-c924-4958-84ee-ec29b3d147f0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:47.463388 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-21ba763d-c924-4958-84ee-ec29b3d147f0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:47.463873 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-21ba763d-c924-4958-84ee-ec29b3d147f0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:47.464632 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-21ba763d-c924-4958-84ee-ec29b3d147f0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:47.465069 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-21ba763d-c924-4958-84ee-ec29b3d147f0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:47.600534 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-21ba763d-c924-4958-84ee-ec29b3d147f0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:47.608550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-21ba763d-c924-4958-84ee-ec29b3d147f0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:47.610081 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-21ba763d-c924-4958-84ee-ec29b3d147f0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:47.611188 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-21ba763d-c924-4958-84ee-ec29b3d147f0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.158710 Jun 15 14:43:47.611744 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 55/111] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:47 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:47.628003 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-62a2ec64-d889-4634-8729-e82f109b4757 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:47.628608 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-62a2ec64-d889-4634-8729-e82f109b4757 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:47.634642 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-62a2ec64-d889-4634-8729-e82f109b4757 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:47.635088 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-62a2ec64-d889-4634-8729-e82f109b4757 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:47.635839 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-62a2ec64-d889-4634-8729-e82f109b4757 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:47.636266 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-62a2ec64-d889-4634-8729-e82f109b4757 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:47.673536 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-18e431d4-0648-4b73-a144-1a878b03f9a1 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:47.674195 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-18e431d4-0648-4b73-a144-1a878b03f9a1 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:47.680469 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-18e431d4-0648-4b73-a144-1a878b03f9a1 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:47.680921 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-18e431d4-0648-4b73-a144-1a878b03f9a1 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:47.681718 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-18e431d4-0648-4b73-a144-1a878b03f9a1 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:47.682160 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-18e431d4-0648-4b73-a144-1a878b03f9a1 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:47.767288 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-62a2ec64-d889-4634-8729-e82f109b4757 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:47.774868 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-62a2ec64-d889-4634-8729-e82f109b4757 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1363 microversion: 2.1 time: 0.152144 Jun 15 14:43:47.775431 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 57/112] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:47 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:47.811322 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-18e431d4-0648-4b73-a144-1a878b03f9a1 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:47.818696 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-18e431d4-0648-4b73-a144-1a878b03f9a1 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1314 microversion: 2.1 time: 0.149237 Jun 15 14:43:47.819264 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 56/113] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:47 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:48.316338 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-4ffe12c1-6897-4327-95d4-6c2d4875c23a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:48.316986 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-4ffe12c1-6897-4327-95d4-6c2d4875c23a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:48.323733 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4ffe12c1-6897-4327-95d4-6c2d4875c23a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:48.324180 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4ffe12c1-6897-4327-95d4-6c2d4875c23a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:48.324943 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4ffe12c1-6897-4327-95d4-6c2d4875c23a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:48.325372 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4ffe12c1-6897-4327-95d4-6c2d4875c23a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:48.456237 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-4ffe12c1-6897-4327-95d4-6c2d4875c23a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:48.463539 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-4ffe12c1-6897-4327-95d4-6c2d4875c23a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.151378 Jun 15 14:43:48.464109 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 58/114] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:48 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:48.628814 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-40342b36-048b-47c7-8cd5-ded6cd7db617 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:48.629423 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-40342b36-048b-47c7-8cd5-ded6cd7db617 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:48.635502 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-40342b36-048b-47c7-8cd5-ded6cd7db617 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:48.635950 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-40342b36-048b-47c7-8cd5-ded6cd7db617 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:48.636709 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-40342b36-048b-47c7-8cd5-ded6cd7db617 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:48.637146 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-40342b36-048b-47c7-8cd5-ded6cd7db617 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:48.767891 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-40342b36-048b-47c7-8cd5-ded6cd7db617 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:48.775703 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-40342b36-048b-47c7-8cd5-ded6cd7db617 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:48.777235 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-40342b36-048b-47c7-8cd5-ded6cd7db617 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:48.778370 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-40342b36-048b-47c7-8cd5-ded6cd7db617 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.153468 Jun 15 14:43:48.779433 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 57/115] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:48 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:48.792054 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-36a05f6f-e67a-4d7d-9830-4f515dd00af1 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:48.792662 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-36a05f6f-e67a-4d7d-9830-4f515dd00af1 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:48.799271 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-36a05f6f-e67a-4d7d-9830-4f515dd00af1 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:48.799728 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-36a05f6f-e67a-4d7d-9830-4f515dd00af1 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:48.800483 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-36a05f6f-e67a-4d7d-9830-4f515dd00af1 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:48.800913 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-36a05f6f-e67a-4d7d-9830-4f515dd00af1 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:48.836152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-7d11b054-670f-4493-99e4-1ce2126b7556 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:48.836689 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-7d11b054-670f-4493-99e4-1ce2126b7556 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:48.843670 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7d11b054-670f-4493-99e4-1ce2126b7556 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:48.844251 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7d11b054-670f-4493-99e4-1ce2126b7556 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:48.845026 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7d11b054-670f-4493-99e4-1ce2126b7556 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:48.845463 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7d11b054-670f-4493-99e4-1ce2126b7556 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:48.928438 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-36a05f6f-e67a-4d7d-9830-4f515dd00af1 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:48.936151 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-36a05f6f-e67a-4d7d-9830-4f515dd00af1 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1363 microversion: 2.1 time: 0.147917 Jun 15 14:43:48.936723 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 59/116] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:48 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:48.972425 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-7d11b054-670f-4493-99e4-1ce2126b7556 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:48.979791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-7d11b054-670f-4493-99e4-1ce2126b7556 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1314 microversion: 2.1 time: 0.147856 Jun 15 14:43:48.980348 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 58/117] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:48 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:49.480227 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-b4d101f4-f385-4bdd-bf26-049c16011d50 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:49.480841 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-b4d101f4-f385-4bdd-bf26-049c16011d50 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:49.483036 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=6 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:49.488804 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b4d101f4-f385-4bdd-bf26-049c16011d50 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:49.489392 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b4d101f4-f385-4bdd-bf26-049c16011d50 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:49.490443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b4d101f4-f385-4bdd-bf26-049c16011d50 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:49.491055 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b4d101f4-f385-4bdd-bf26-049c16011d50 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:49.681608 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b4d101f4-f385-4bdd-bf26-049c16011d50 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:49.698013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-b4d101f4-f385-4bdd-bf26-049c16011d50 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.221442 Jun 15 14:43:49.698588 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 60/118] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:49 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:49.797335 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-9f928fb0-ba2d-4b5e-9ee9-e1a0a56f1a28 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:49.798124 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-9f928fb0-ba2d-4b5e-9ee9-e1a0a56f1a28 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:49.804289 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9f928fb0-ba2d-4b5e-9ee9-e1a0a56f1a28 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:49.804747 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9f928fb0-ba2d-4b5e-9ee9-e1a0a56f1a28 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:49.805521 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9f928fb0-ba2d-4b5e-9ee9-e1a0a56f1a28 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:49.805985 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9f928fb0-ba2d-4b5e-9ee9-e1a0a56f1a28 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:49.952640 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-caa9ed86-2560-4420-ba21-e07325061db9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:49.953479 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-caa9ed86-2560-4420-ba21-e07325061db9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:49.959748 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-caa9ed86-2560-4420-ba21-e07325061db9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:49.960197 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-caa9ed86-2560-4420-ba21-e07325061db9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:49.961217 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-caa9ed86-2560-4420-ba21-e07325061db9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:49.961651 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-caa9ed86-2560-4420-ba21-e07325061db9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:49.964380 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=100 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:50.106442 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-caa9ed86-2560-4420-ba21-e07325061db9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:50.115310 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-caa9ed86-2560-4420-ba21-e07325061db9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1363 microversion: 2.1 time: 0.166786 Jun 15 14:43:50.116073 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 61/119] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:49 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:50.130001 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-009db83d-dee0-4c7f-92b7-b8438bb54dc2 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:50.131377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-009db83d-dee0-4c7f-92b7-b8438bb54dc2 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:50.139333 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-009db83d-dee0-4c7f-92b7-b8438bb54dc2 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:50.140422 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-009db83d-dee0-4c7f-92b7-b8438bb54dc2 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:50.145515 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9f928fb0-ba2d-4b5e-9ee9-e1a0a56f1a28 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:50.147950 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-009db83d-dee0-4c7f-92b7-b8438bb54dc2 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:50.148560 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-009db83d-dee0-4c7f-92b7-b8438bb54dc2 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:50.160139 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9f928fb0-ba2d-4b5e-9ee9-e1a0a56f1a28 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:50.197869 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9f928fb0-ba2d-4b5e-9ee9-e1a0a56f1a28 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:50.200724 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-9f928fb0-ba2d-4b5e-9ee9-e1a0a56f1a28 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.406764 Jun 15 14:43:50.201343 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 59/120] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:49 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:50.500948 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-009db83d-dee0-4c7f-92b7-b8438bb54dc2 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:50.513181 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-009db83d-dee0-4c7f-92b7-b8438bb54dc2 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1314 microversion: 2.1 time: 0.395998 Jun 15 14:43:50.515415 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 62/121] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:50 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:50.715913 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-72dfad07-259d-4857-89fd-292df7a656d1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:50.717219 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-72dfad07-259d-4857-89fd-292df7a656d1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:50.726647 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-72dfad07-259d-4857-89fd-292df7a656d1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:50.727099 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-72dfad07-259d-4857-89fd-292df7a656d1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:50.728019 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-72dfad07-259d-4857-89fd-292df7a656d1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:50.729720 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-72dfad07-259d-4857-89fd-292df7a656d1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:50.896349 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-72dfad07-259d-4857-89fd-292df7a656d1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:50.904389 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-72dfad07-259d-4857-89fd-292df7a656d1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.191871 Jun 15 14:43:50.905682 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 60/122] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:50 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:51.133984 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-b1556ea0-ff45-4348-9c5f-28a1b1009a2c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:51.135050 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-b1556ea0-ff45-4348-9c5f-28a1b1009a2c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:51.143307 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b1556ea0-ff45-4348-9c5f-28a1b1009a2c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:51.144346 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b1556ea0-ff45-4348-9c5f-28a1b1009a2c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:51.145838 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b1556ea0-ff45-4348-9c5f-28a1b1009a2c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:51.146395 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b1556ea0-ff45-4348-9c5f-28a1b1009a2c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:51.234935 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-f88cb6c5-075a-4505-a6bf-f797e2bc53fb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:51.239564 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-f88cb6c5-075a-4505-a6bf-f797e2bc53fb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:51.255300 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f88cb6c5-075a-4505-a6bf-f797e2bc53fb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:51.255875 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f88cb6c5-075a-4505-a6bf-f797e2bc53fb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:51.256878 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f88cb6c5-075a-4505-a6bf-f797e2bc53fb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:51.257595 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f88cb6c5-075a-4505-a6bf-f797e2bc53fb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:51.315351 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=100 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:51.525695 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-f88cb6c5-075a-4505-a6bf-f797e2bc53fb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:51.535612 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-f88cb6c5-075a-4505-a6bf-f797e2bc53fb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:51.537412 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-f88cb6c5-075a-4505-a6bf-f797e2bc53fb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:51.538621 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-f88cb6c5-075a-4505-a6bf-f797e2bc53fb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.323193 Jun 15 14:43:51.539715 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 61/123] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:51 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:51.546040 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-9128fe76-cc47-4678-af02-fecd9f674456 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:51.546659 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-9128fe76-cc47-4678-af02-fecd9f674456 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:51.552746 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9128fe76-cc47-4678-af02-fecd9f674456 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:51.553606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9128fe76-cc47-4678-af02-fecd9f674456 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:51.554418 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9128fe76-cc47-4678-af02-fecd9f674456 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:51.554849 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9128fe76-cc47-4678-af02-fecd9f674456 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:51.710128 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9128fe76-cc47-4678-af02-fecd9f674456 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:51.718915 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-9128fe76-cc47-4678-af02-fecd9f674456 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1314 microversion: 2.1 time: 0.177922 Jun 15 14:43:51.719813 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 62/124] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:51 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:51.725340 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b1556ea0-ff45-4348-9c5f-28a1b1009a2c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:51.734965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-b1556ea0-ff45-4348-9c5f-28a1b1009a2c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1363 microversion: 2.1 time: 0.606118 Jun 15 14:43:51.735543 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 63/125] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:51 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1363 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:51.923204 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-76189edc-ead1-40be-8798-4019ad6c95c6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:51.923953 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-76189edc-ead1-40be-8798-4019ad6c95c6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:51.929959 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-76189edc-ead1-40be-8798-4019ad6c95c6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:51.930409 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-76189edc-ead1-40be-8798-4019ad6c95c6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:51.931164 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-76189edc-ead1-40be-8798-4019ad6c95c6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:51.931597 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-76189edc-ead1-40be-8798-4019ad6c95c6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:52.078535 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-76189edc-ead1-40be-8798-4019ad6c95c6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:52.086064 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-76189edc-ead1-40be-8798-4019ad6c95c6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.167119 Jun 15 14:43:52.086619 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 63/126] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:51 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:52.557972 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-adfcdbcb-d70b-447f-ae16-19ac99b3397b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:52.558639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-adfcdbcb-d70b-447f-ae16-19ac99b3397b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:52.568450 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-adfcdbcb-d70b-447f-ae16-19ac99b3397b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:52.568968 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-adfcdbcb-d70b-447f-ae16-19ac99b3397b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:52.569843 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-adfcdbcb-d70b-447f-ae16-19ac99b3397b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:52.570491 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-adfcdbcb-d70b-447f-ae16-19ac99b3397b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:52.736574 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-7060f218-5237-469b-b058-d18bdc5ec8f6 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:52.737542 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-7060f218-5237-469b-b058-d18bdc5ec8f6 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:52.742665 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-adfcdbcb-d70b-447f-ae16-19ac99b3397b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:52.751118 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7060f218-5237-469b-b058-d18bdc5ec8f6 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:52.751662 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7060f218-5237-469b-b058-d18bdc5ec8f6 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:52.752668 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7060f218-5237-469b-b058-d18bdc5ec8f6 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:52.753172 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7060f218-5237-469b-b058-d18bdc5ec8f6 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:52.753863 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-adfcdbcb-d70b-447f-ae16-19ac99b3397b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:52.755695 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-adfcdbcb-d70b-447f-ae16-19ac99b3397b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:52.757182 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-adfcdbcb-d70b-447f-ae16-19ac99b3397b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.203281 Jun 15 14:43:52.758406 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 64/127] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:52 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:52.765248 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-61239133-419a-4ec6-81da-e4ce6ef8d1a8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:52.766254 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-61239133-419a-4ec6-81da-e4ce6ef8d1a8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:52.772733 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-61239133-419a-4ec6-81da-e4ce6ef8d1a8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:52.773307 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-61239133-419a-4ec6-81da-e4ce6ef8d1a8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:52.774209 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-61239133-419a-4ec6-81da-e4ce6ef8d1a8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:52.774761 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-61239133-419a-4ec6-81da-e4ce6ef8d1a8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:52.890361 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-7060f218-5237-469b-b058-d18bdc5ec8f6 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:52.897800 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-7060f218-5237-469b-b058-d18bdc5ec8f6 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1314 microversion: 2.1 time: 0.165683 Jun 15 14:43:52.898372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 64/128] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:52 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:52.983266 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-61239133-419a-4ec6-81da-e4ce6ef8d1a8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:52.990707 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-61239133-419a-4ec6-81da-e4ce6ef8d1a8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1363 microversion: 2.1 time: 0.230990 Jun 15 14:43:52.991274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 65/129] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:52 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:53.108128 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-91bc1982-2026-4cbe-b079-b21dc9f43dc4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:53.109230 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-91bc1982-2026-4cbe-b079-b21dc9f43dc4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:53.118624 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-91bc1982-2026-4cbe-b079-b21dc9f43dc4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:53.119783 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-91bc1982-2026-4cbe-b079-b21dc9f43dc4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:53.120658 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-91bc1982-2026-4cbe-b079-b21dc9f43dc4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:53.121455 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-91bc1982-2026-4cbe-b079-b21dc9f43dc4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:53.285428 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-91bc1982-2026-4cbe-b079-b21dc9f43dc4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:53.299341 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-91bc1982-2026-4cbe-b079-b21dc9f43dc4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.197703 Jun 15 14:43:53.299925 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 65/130] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:53 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:53.325716 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-961f04e8-b119-42e2-9506-bc041a333b17 req-03c2765b-b992-4dc6-aca3-f16a92bbeff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "401c9feb-30ca-4df6-9fba-0a05da5dce7b", "name": "network-vif-plugged", "status": "completed", "tag": "fb5c9876-5726-466e-a543-a3f84f0df112"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:53.336526 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-961f04e8-b119-42e2-9506-bc041a333b17 req-03c2765b-b992-4dc6-aca3-f16a92bbeff1 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:53.337143 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-961f04e8-b119-42e2-9506-bc041a333b17 req-03c2765b-b992-4dc6-aca3-f16a92bbeff1 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:53.351214 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-961f04e8-b119-42e2-9506-bc041a333b17 req-03c2765b-b992-4dc6-aca3-f16a92bbeff1 service nova] Creating event network-vif-plugged:fb5c9876-5726-466e-a543-a3f84f0df112 for instance 401c9feb-30ca-4df6-9fba-0a05da5dce7b on hv-cinder-84327 Jun 15 14:43:53.356468 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-961f04e8-b119-42e2-9506-bc041a333b17 req-03c2765b-b992-4dc6-aca3-f16a92bbeff1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034599 Jun 15 14:43:53.357346 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 66/131] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:53.775138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-3dc53f05-4ded-4e50-b3e0-575d4e4cbdb3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:53.775745 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-3dc53f05-4ded-4e50-b3e0-575d4e4cbdb3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:53.782851 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3dc53f05-4ded-4e50-b3e0-575d4e4cbdb3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:53.783298 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3dc53f05-4ded-4e50-b3e0-575d4e4cbdb3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:53.784069 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3dc53f05-4ded-4e50-b3e0-575d4e4cbdb3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:53.784498 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3dc53f05-4ded-4e50-b3e0-575d4e4cbdb3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:53.912444 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-3dc53f05-4ded-4e50-b3e0-575d4e4cbdb3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:53.915276 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e6d8a500-b0db-4c98-b7a4-63250726b764 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:53.915986 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-e6d8a500-b0db-4c98-b7a4-63250726b764 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:53.921050 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-3dc53f05-4ded-4e50-b3e0-575d4e4cbdb3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:53.922596 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-3dc53f05-4ded-4e50-b3e0-575d4e4cbdb3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:53.923332 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e6d8a500-b0db-4c98-b7a4-63250726b764 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:53.923699 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-3dc53f05-4ded-4e50-b3e0-575d4e4cbdb3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.152498 Jun 15 14:43:53.923800 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e6d8a500-b0db-4c98-b7a4-63250726b764 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:53.924255 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 66/132] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:53 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:53.934083 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e6d8a500-b0db-4c98-b7a4-63250726b764 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:53.934564 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e6d8a500-b0db-4c98-b7a4-63250726b764 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:54.008342 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-0a546416-931b-4a30-9e97-36a8495c8d47 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:54.008960 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-0a546416-931b-4a30-9e97-36a8495c8d47 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:54.016590 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0a546416-931b-4a30-9e97-36a8495c8d47 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:54.017018 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0a546416-931b-4a30-9e97-36a8495c8d47 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:54.017809 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0a546416-931b-4a30-9e97-36a8495c8d47 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:54.018556 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0a546416-931b-4a30-9e97-36a8495c8d47 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:54.084870 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e6d8a500-b0db-4c98-b7a4-63250726b764 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:54.094057 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-e6d8a500-b0db-4c98-b7a4-63250726b764 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1314 microversion: 2.1 time: 0.182581 Jun 15 14:43:54.096226 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 67/133] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:53 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:54.186884 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-0a546416-931b-4a30-9e97-36a8495c8d47 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:54.194521 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-0a546416-931b-4a30-9e97-36a8495c8d47 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1363 microversion: 2.1 time: 0.190156 Jun 15 14:43:54.195095 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 67/134] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:54 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:54.315853 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-b4f8aae8-1726-4ba0-8310-a230b5139f9a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:54.316459 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-b4f8aae8-1726-4ba0-8310-a230b5139f9a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:54.318435 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:54.323452 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b4f8aae8-1726-4ba0-8310-a230b5139f9a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:54.323907 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b4f8aae8-1726-4ba0-8310-a230b5139f9a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:54.324661 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b4f8aae8-1726-4ba0-8310-a230b5139f9a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:54.325099 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b4f8aae8-1726-4ba0-8310-a230b5139f9a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:54.478079 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b4f8aae8-1726-4ba0-8310-a230b5139f9a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:54.486087 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-b4f8aae8-1726-4ba0-8310-a230b5139f9a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.173917 Jun 15 14:43:54.486877 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 68/135] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:54 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:54.942195 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6d270aa4-9a6b-45ee-aa73-2f56bbc76339 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:54.943082 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6d270aa4-9a6b-45ee-aa73-2f56bbc76339 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:54.949204 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6d270aa4-9a6b-45ee-aa73-2f56bbc76339 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:54.949670 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6d270aa4-9a6b-45ee-aa73-2f56bbc76339 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:54.950445 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6d270aa4-9a6b-45ee-aa73-2f56bbc76339 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:54.950896 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6d270aa4-9a6b-45ee-aa73-2f56bbc76339 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:55.091483 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6d270aa4-9a6b-45ee-aa73-2f56bbc76339 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:55.100770 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6d270aa4-9a6b-45ee-aa73-2f56bbc76339 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:55.102571 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6d270aa4-9a6b-45ee-aa73-2f56bbc76339 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:55.103863 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-6d270aa4-9a6b-45ee-aa73-2f56bbc76339 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.166329 Jun 15 14:43:55.104725 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 68/136] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:54 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:55.114465 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-10bdc849-7e57-4aa7-9341-b3f7d3e1b35d tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:55.115834 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-10bdc849-7e57-4aa7-9341-b3f7d3e1b35d tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:55.122360 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-10bdc849-7e57-4aa7-9341-b3f7d3e1b35d tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:55.122835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-10bdc849-7e57-4aa7-9341-b3f7d3e1b35d tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:55.124238 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-10bdc849-7e57-4aa7-9341-b3f7d3e1b35d tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:55.124681 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-10bdc849-7e57-4aa7-9341-b3f7d3e1b35d tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:55.212735 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-65ac6f95-c3ba-4b1b-9dfa-41acc5bb7068 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:55.213433 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-65ac6f95-c3ba-4b1b-9dfa-41acc5bb7068 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:55.220256 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-65ac6f95-c3ba-4b1b-9dfa-41acc5bb7068 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:55.220979 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-65ac6f95-c3ba-4b1b-9dfa-41acc5bb7068 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:55.221847 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-65ac6f95-c3ba-4b1b-9dfa-41acc5bb7068 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:55.222464 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-65ac6f95-c3ba-4b1b-9dfa-41acc5bb7068 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:55.299923 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-10bdc849-7e57-4aa7-9341-b3f7d3e1b35d tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:55.307299 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-10bdc849-7e57-4aa7-9341-b3f7d3e1b35d tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1314 microversion: 2.1 time: 0.198138 Jun 15 14:43:55.307872 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 69/137] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:55 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:55.390271 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-65ac6f95-c3ba-4b1b-9dfa-41acc5bb7068 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:55.398001 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-65ac6f95-c3ba-4b1b-9dfa-41acc5bb7068 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1363 microversion: 2.1 time: 0.189717 Jun 15 14:43:55.398569 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 69/138] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:55 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:43:55.504320 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e35c9277-288b-4e2f-b111-9ed7c3cb02ca tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:55.505140 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-e35c9277-288b-4e2f-b111-9ed7c3cb02ca tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:55.511802 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e35c9277-288b-4e2f-b111-9ed7c3cb02ca tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:55.512459 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e35c9277-288b-4e2f-b111-9ed7c3cb02ca tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:55.513232 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e35c9277-288b-4e2f-b111-9ed7c3cb02ca tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:55.514612 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e35c9277-288b-4e2f-b111-9ed7c3cb02ca tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:55.663050 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e35c9277-288b-4e2f-b111-9ed7c3cb02ca tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:55.671573 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-e35c9277-288b-4e2f-b111-9ed7c3cb02ca tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.170959 Jun 15 14:43:55.672155 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 70/139] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:55 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:56.125038 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-8856c622-ac18-4159-bee7-04b606d8a886 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:56.125681 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-8856c622-ac18-4159-bee7-04b606d8a886 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:56.146762 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8856c622-ac18-4159-bee7-04b606d8a886 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:56.146762 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8856c622-ac18-4159-bee7-04b606d8a886 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:56.149329 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8856c622-ac18-4159-bee7-04b606d8a886 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:56.151285 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8856c622-ac18-4159-bee7-04b606d8a886 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:56.325071 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c121d472-c0d7-4806-864b-0bdf9d932e4b tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:56.325710 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c121d472-c0d7-4806-864b-0bdf9d932e4b tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:56.338250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c121d472-c0d7-4806-864b-0bdf9d932e4b tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:56.338844 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c121d472-c0d7-4806-864b-0bdf9d932e4b tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:56.339468 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c121d472-c0d7-4806-864b-0bdf9d932e4b tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:56.339925 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c121d472-c0d7-4806-864b-0bdf9d932e4b tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:56.403222 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-8856c622-ac18-4159-bee7-04b606d8a886 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:56.415325 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-8856c622-ac18-4159-bee7-04b606d8a886 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:56.417590 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-8856c622-ac18-4159-bee7-04b606d8a886 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:56.418752 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-8856c622-ac18-4159-bee7-04b606d8a886 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.299369 Jun 15 14:43:56.421221 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 70/140] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:56 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:56.436276 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c92362d8-5e9d-4403-ab75-a32aa025f5fe tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:56.437046 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-c92362d8-5e9d-4403-ab75-a32aa025f5fe tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:56.454618 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c92362d8-5e9d-4403-ab75-a32aa025f5fe tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:56.455248 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c92362d8-5e9d-4403-ab75-a32aa025f5fe tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:56.456081 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c92362d8-5e9d-4403-ab75-a32aa025f5fe tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:56.456583 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c92362d8-5e9d-4403-ab75-a32aa025f5fe tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:56.539027 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c121d472-c0d7-4806-864b-0bdf9d932e4b tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:56.550273 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-c121d472-c0d7-4806-864b-0bdf9d932e4b tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1501 microversion: 2.1 time: 0.229293 Jun 15 14:43:56.550854 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 71/141] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:56 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1501 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:56.657976 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-c92362d8-5e9d-4403-ab75-a32aa025f5fe tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:56.668332 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-c92362d8-5e9d-4403-ab75-a32aa025f5fe tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1363 microversion: 2.1 time: 0.245101 Jun 15 14:43:56.668930 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 71/142] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:56 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:56.689698 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c2bf73b9-7e4b-4f9f-8955-2f95d30dfb6a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:56.690316 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c2bf73b9-7e4b-4f9f-8955-2f95d30dfb6a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:56.696805 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c2bf73b9-7e4b-4f9f-8955-2f95d30dfb6a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:56.697231 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c2bf73b9-7e4b-4f9f-8955-2f95d30dfb6a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:56.704125 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c2bf73b9-7e4b-4f9f-8955-2f95d30dfb6a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:56.704725 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c2bf73b9-7e4b-4f9f-8955-2f95d30dfb6a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:57.063856 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c2bf73b9-7e4b-4f9f-8955-2f95d30dfb6a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:57.078413 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-c2bf73b9-7e4b-4f9f-8955-2f95d30dfb6a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.388547 Jun 15 14:43:57.086554 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 72/143] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:56 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:57.439217 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-3a1f4a66-261a-4d5c-942b-f6836a4808da tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:57.439829 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-3a1f4a66-261a-4d5c-942b-f6836a4808da tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:57.446037 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3a1f4a66-261a-4d5c-942b-f6836a4808da tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:57.446882 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3a1f4a66-261a-4d5c-942b-f6836a4808da tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:57.447653 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3a1f4a66-261a-4d5c-942b-f6836a4808da tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:57.448159 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3a1f4a66-261a-4d5c-942b-f6836a4808da tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:57.617745 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-3a1f4a66-261a-4d5c-942b-f6836a4808da tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:57.627877 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-3a1f4a66-261a-4d5c-942b-f6836a4808da tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:57.629372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-3a1f4a66-261a-4d5c-942b-f6836a4808da tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:57.630511 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-3a1f4a66-261a-4d5c-942b-f6836a4808da tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.196167 Jun 15 14:43:57.631062 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 72/144] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:57 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:57.687795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-6680375e-9812-49c9-97b4-e72b5483ea2b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:57.688970 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-6680375e-9812-49c9-97b4-e72b5483ea2b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:57.695337 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6680375e-9812-49c9-97b4-e72b5483ea2b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:57.695954 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6680375e-9812-49c9-97b4-e72b5483ea2b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:57.697169 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6680375e-9812-49c9-97b4-e72b5483ea2b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:57.697788 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6680375e-9812-49c9-97b4-e72b5483ea2b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:57.887708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-6680375e-9812-49c9-97b4-e72b5483ea2b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:57.897124 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-6680375e-9812-49c9-97b4-e72b5483ea2b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1363 microversion: 2.1 time: 0.214107 Jun 15 14:43:57.897790 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 73/145] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:57 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:58.101170 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-cbda5c4a-4f69-4962-b477-a63e0c0dd5dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:58.102153 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-cbda5c4a-4f69-4962-b477-a63e0c0dd5dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:58.111867 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cbda5c4a-4f69-4962-b477-a63e0c0dd5dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:58.112321 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cbda5c4a-4f69-4962-b477-a63e0c0dd5dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:58.113100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cbda5c4a-4f69-4962-b477-a63e0c0dd5dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:58.113535 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cbda5c4a-4f69-4962-b477-a63e0c0dd5dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:58.279847 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-cbda5c4a-4f69-4962-b477-a63e0c0dd5dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:58.288591 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-cbda5c4a-4f69-4962-b477-a63e0c0dd5dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.195178 Jun 15 14:43:58.289463 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 73/146] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:58 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:58.650992 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-461029f0-d6de-47b9-9add-25120e12720b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:58.651968 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-461029f0-d6de-47b9-9add-25120e12720b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:58.660067 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-461029f0-d6de-47b9-9add-25120e12720b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:58.660732 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-461029f0-d6de-47b9-9add-25120e12720b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:58.661910 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-461029f0-d6de-47b9-9add-25120e12720b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:58.662491 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-461029f0-d6de-47b9-9add-25120e12720b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:58.811855 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-461029f0-d6de-47b9-9add-25120e12720b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:58.821730 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-461029f0-d6de-47b9-9add-25120e12720b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:58.823251 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-461029f0-d6de-47b9-9add-25120e12720b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:58.824316 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-461029f0-d6de-47b9-9add-25120e12720b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.179876 Jun 15 14:43:58.825055 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 74/147] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:58 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:58.914868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-37e93ad8-b0fa-40be-8ddc-8f3df4303ae8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:58.915616 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-37e93ad8-b0fa-40be-8ddc-8f3df4303ae8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:58.921957 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-37e93ad8-b0fa-40be-8ddc-8f3df4303ae8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:58.922418 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-37e93ad8-b0fa-40be-8ddc-8f3df4303ae8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:58.923177 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-37e93ad8-b0fa-40be-8ddc-8f3df4303ae8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:58.923613 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-37e93ad8-b0fa-40be-8ddc-8f3df4303ae8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:59.066439 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-37e93ad8-b0fa-40be-8ddc-8f3df4303ae8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:59.074827 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-37e93ad8-b0fa-40be-8ddc-8f3df4303ae8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1363 microversion: 2.1 time: 0.163758 Jun 15 14:43:59.075583 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 74/148] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:58 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:59.306623 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e6c4330f-f14e-41f5-a76b-2f4f5a84c473 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:59.307627 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-e6c4330f-f14e-41f5-a76b-2f4f5a84c473 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:59.316168 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e6c4330f-f14e-41f5-a76b-2f4f5a84c473 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:59.316913 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e6c4330f-f14e-41f5-a76b-2f4f5a84c473 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:59.318055 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e6c4330f-f14e-41f5-a76b-2f4f5a84c473 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:59.318685 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e6c4330f-f14e-41f5-a76b-2f4f5a84c473 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:59.470335 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e6c4330f-f14e-41f5-a76b-2f4f5a84c473 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:59.480815 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-e6c4330f-f14e-41f5-a76b-2f4f5a84c473 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.176616 Jun 15 14:43:59.481558 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 75/149] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:43:59 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:59.843209 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-52b41e81-bd15-4526-af2c-0c7b585a68ee tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:59.843818 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-52b41e81-bd15-4526-af2c-0c7b585a68ee tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:43:59.849902 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-52b41e81-bd15-4526-af2c-0c7b585a68ee tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:59.850340 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-52b41e81-bd15-4526-af2c-0c7b585a68ee tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:59.851106 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-52b41e81-bd15-4526-af2c-0c7b585a68ee tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:43:59.851539 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-52b41e81-bd15-4526-af2c-0c7b585a68ee tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:43:59.984820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-52b41e81-bd15-4526-af2c-0c7b585a68ee tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:59.994813 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-52b41e81-bd15-4526-af2c-0c7b585a68ee tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:59.996619 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-52b41e81-bd15-4526-af2c-0c7b585a68ee tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:43:59.998776 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-52b41e81-bd15-4526-af2c-0c7b585a68ee tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.159503 Jun 15 14:43:59.999390 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 75/150] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:43:59 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:00.092666 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-50ef7467-6244-4e89-9767-e00b6a020605 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:00.093266 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-50ef7467-6244-4e89-9767-e00b6a020605 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:00.099392 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-50ef7467-6244-4e89-9767-e00b6a020605 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:00.099843 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-50ef7467-6244-4e89-9767-e00b6a020605 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:00.100609 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-50ef7467-6244-4e89-9767-e00b6a020605 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:00.101042 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-50ef7467-6244-4e89-9767-e00b6a020605 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:00.232478 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-50ef7467-6244-4e89-9767-e00b6a020605 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:00.240415 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-50ef7467-6244-4e89-9767-e00b6a020605 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1363 microversion: 2.1 time: 0.151664 Jun 15 14:44:00.240994 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 76/151] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:00 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:00.498264 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-b8677066-81b3-4edb-b7c3-7956910443e2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:00.499122 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-b8677066-81b3-4edb-b7c3-7956910443e2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:00.505522 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b8677066-81b3-4edb-b7c3-7956910443e2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:00.506009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b8677066-81b3-4edb-b7c3-7956910443e2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:00.506781 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b8677066-81b3-4edb-b7c3-7956910443e2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:00.507217 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b8677066-81b3-4edb-b7c3-7956910443e2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:00.646757 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-b8677066-81b3-4edb-b7c3-7956910443e2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:00.656401 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-b8677066-81b3-4edb-b7c3-7956910443e2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.161755 Jun 15 14:44:00.657181 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 76/152] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:00 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:01.016572 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-08287392-bf5c-473b-891d-fcab021d6075 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:01.017083 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-08287392-bf5c-473b-891d-fcab021d6075 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:01.023004 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-08287392-bf5c-473b-891d-fcab021d6075 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:01.023448 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-08287392-bf5c-473b-891d-fcab021d6075 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:01.024196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-08287392-bf5c-473b-891d-fcab021d6075 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:01.024625 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-08287392-bf5c-473b-891d-fcab021d6075 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:01.152629 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-08287392-bf5c-473b-891d-fcab021d6075 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:01.161552 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-08287392-bf5c-473b-891d-fcab021d6075 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:01.163088 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-08287392-bf5c-473b-891d-fcab021d6075 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:01.164213 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-08287392-bf5c-473b-891d-fcab021d6075 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.151870 Jun 15 14:44:01.164761 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 77/153] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:01 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:01.257547 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-e546a7e3-23b6-405a-9558-a0e55c63fcf2 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:01.258187 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-e546a7e3-23b6-405a-9558-a0e55c63fcf2 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:01.264386 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e546a7e3-23b6-405a-9558-a0e55c63fcf2 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:01.264950 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e546a7e3-23b6-405a-9558-a0e55c63fcf2 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:01.265633 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e546a7e3-23b6-405a-9558-a0e55c63fcf2 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:01.266090 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e546a7e3-23b6-405a-9558-a0e55c63fcf2 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:01.574853 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e546a7e3-23b6-405a-9558-a0e55c63fcf2 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:01.578905 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=100 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:01.583997 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-e546a7e3-23b6-405a-9558-a0e55c63fcf2 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1363 microversion: 2.1 time: 0.330173 Jun 15 14:44:01.584646 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 77/154] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:01 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1363 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:01.673369 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0e785932-40cb-496d-a15c-f4275fdd6150 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:01.674014 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-0e785932-40cb-496d-a15c-f4275fdd6150 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:01.680010 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0e785932-40cb-496d-a15c-f4275fdd6150 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:01.680464 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0e785932-40cb-496d-a15c-f4275fdd6150 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:01.681221 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0e785932-40cb-496d-a15c-f4275fdd6150 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:01.681671 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0e785932-40cb-496d-a15c-f4275fdd6150 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:01.697271 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=100 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:01.827303 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0e785932-40cb-496d-a15c-f4275fdd6150 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:01.836527 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-0e785932-40cb-496d-a15c-f4275fdd6150 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.166537 Jun 15 14:44:01.837613 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 78/155] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:01 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:02.184211 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-13a6dfae-f15e-4564-9488-43b7a67780bb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:02.185009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-13a6dfae-f15e-4564-9488-43b7a67780bb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:02.196964 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-13a6dfae-f15e-4564-9488-43b7a67780bb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:02.197786 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-13a6dfae-f15e-4564-9488-43b7a67780bb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:02.198983 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-13a6dfae-f15e-4564-9488-43b7a67780bb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:02.199811 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-13a6dfae-f15e-4564-9488-43b7a67780bb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:02.360086 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-13a6dfae-f15e-4564-9488-43b7a67780bb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:02.372721 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-13a6dfae-f15e-4564-9488-43b7a67780bb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:02.376315 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-13a6dfae-f15e-4564-9488-43b7a67780bb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:02.380679 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-13a6dfae-f15e-4564-9488-43b7a67780bb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.202181 Jun 15 14:44:02.382114 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 78/156] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:02 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:02.427841 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-ad6a0988-fb0a-4ab2-83c0-7e3cb169774e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96e437f6-b0f1-4866-8635-a581354509c5"}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:44:02.429048 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-ad6a0988-fb0a-4ab2-83c0-7e3cb169774e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:02.435499 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ad6a0988-fb0a-4ab2-83c0-7e3cb169774e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:02.436232 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ad6a0988-fb0a-4ab2-83c0-7e3cb169774e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:02.437153 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ad6a0988-fb0a-4ab2-83c0-7e3cb169774e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:02.437811 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ad6a0988-fb0a-4ab2-83c0-7e3cb169774e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:02.549562 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-f6d49211-a80a-4a8a-83d8-430e3dad42e6 req-fc11dea0-1357-4e0e-b63b-0af62c475da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373c3c82-91e0-4d91-8933-c2dbe3582fee", "name": "network-vif-plugged", "status": "completed", "tag": "ddfa8e08-5c5d-4799-9986-83a3e2b1e12e"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:44:02.557884 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-f6d49211-a80a-4a8a-83d8-430e3dad42e6 req-fc11dea0-1357-4e0e-b63b-0af62c475da3 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:02.558324 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-f6d49211-a80a-4a8a-83d8-430e3dad42e6 req-fc11dea0-1357-4e0e-b63b-0af62c475da3 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:02.581829 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-f6d49211-a80a-4a8a-83d8-430e3dad42e6 req-fc11dea0-1357-4e0e-b63b-0af62c475da3 service nova] Creating event network-vif-plugged:ddfa8e08-5c5d-4799-9986-83a3e2b1e12e for instance 373c3c82-91e0-4d91-8933-c2dbe3582fee on hv-cinder-84327 Jun 15 14:44:02.589432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-f6d49211-a80a-4a8a-83d8-430e3dad42e6 req-fc11dea0-1357-4e0e-b63b-0af62c475da3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043167 Jun 15 14:44:02.590398 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 79/157] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:44:02.604677 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-07b9f03f-c46a-43b4-b5df-2fc0412fe71e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:02.605752 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-07b9f03f-c46a-43b4-b5df-2fc0412fe71e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:02.613528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-07b9f03f-c46a-43b4-b5df-2fc0412fe71e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:02.614056 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-07b9f03f-c46a-43b4-b5df-2fc0412fe71e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:02.614984 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-07b9f03f-c46a-43b4-b5df-2fc0412fe71e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:02.615431 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-07b9f03f-c46a-43b4-b5df-2fc0412fe71e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:02.784441 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-07b9f03f-c46a-43b4-b5df-2fc0412fe71e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:02.793050 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-07b9f03f-c46a-43b4-b5df-2fc0412fe71e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1363 microversion: 2.1 time: 0.193296 Jun 15 14:44:02.793894 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 80/158] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:02 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:02.856982 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-7600a23f-e84d-4b10-9f86-41b4b70df05d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:02.858318 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-7600a23f-e84d-4b10-9f86-41b4b70df05d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:02.867430 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7600a23f-e84d-4b10-9f86-41b4b70df05d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:02.868171 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7600a23f-e84d-4b10-9f86-41b4b70df05d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:02.869635 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7600a23f-e84d-4b10-9f86-41b4b70df05d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:02.870375 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7600a23f-e84d-4b10-9f86-41b4b70df05d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:03.026651 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-7600a23f-e84d-4b10-9f86-41b4b70df05d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:03.034518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-7600a23f-e84d-4b10-9f86-41b4b70df05d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.183957 Jun 15 14:44:03.035093 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 81/159] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:02 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:03.069260 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-ad6a0988-fb0a-4ab2-83c0-7e3cb169774e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "POST /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.645369 Jun 15 14:44:03.069964 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 79/160] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 14:44:02 2022] POST /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87/os-volume_attachments => generated 194 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:44:03.402600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-0434cf1e-6f5e-44ca-80a9-497b150f690c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:03.403756 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-0434cf1e-6f5e-44ca-80a9-497b150f690c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:03.419739 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0434cf1e-6f5e-44ca-80a9-497b150f690c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:03.420712 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0434cf1e-6f5e-44ca-80a9-497b150f690c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:03.421871 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0434cf1e-6f5e-44ca-80a9-497b150f690c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:03.422313 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0434cf1e-6f5e-44ca-80a9-497b150f690c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:03.657748 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-0434cf1e-6f5e-44ca-80a9-497b150f690c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:03.668879 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-0434cf1e-6f5e-44ca-80a9-497b150f690c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:03.672337 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-0434cf1e-6f5e-44ca-80a9-497b150f690c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:03.673473 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-0434cf1e-6f5e-44ca-80a9-497b150f690c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.277276 Jun 15 14:44:03.674492 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 82/161] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:03 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:03.813420 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f38d7878-c3e6-445c-b721-d5a4a7312eaf tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:03.814175 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f38d7878-c3e6-445c-b721-d5a4a7312eaf tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:03.822597 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f38d7878-c3e6-445c-b721-d5a4a7312eaf tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:03.823252 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f38d7878-c3e6-445c-b721-d5a4a7312eaf tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:03.824516 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f38d7878-c3e6-445c-b721-d5a4a7312eaf tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:03.825111 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f38d7878-c3e6-445c-b721-d5a4a7312eaf tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:04.007752 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f38d7878-c3e6-445c-b721-d5a4a7312eaf tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:04.016452 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f38d7878-c3e6-445c-b721-d5a4a7312eaf tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1363 microversion: 2.1 time: 0.210099 Jun 15 14:44:04.026757 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 80/162] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:03 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:04.054485 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-26720b08-479e-41c0-8af4-34059239e4bd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:04.055452 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-26720b08-479e-41c0-8af4-34059239e4bd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:04.064341 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-26720b08-479e-41c0-8af4-34059239e4bd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:04.064914 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-26720b08-479e-41c0-8af4-34059239e4bd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:04.065849 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-26720b08-479e-41c0-8af4-34059239e4bd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:04.066923 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-26720b08-479e-41c0-8af4-34059239e4bd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:04.259984 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-26720b08-479e-41c0-8af4-34059239e4bd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:04.271682 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-26720b08-479e-41c0-8af4-34059239e4bd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.223353 Jun 15 14:44:04.272266 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 83/163] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:04 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:04.694536 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-b4cf9414-0556-4420-8e50-9556b8079f4e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:04.695368 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-b4cf9414-0556-4420-8e50-9556b8079f4e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:04.701646 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b4cf9414-0556-4420-8e50-9556b8079f4e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:04.702123 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b4cf9414-0556-4420-8e50-9556b8079f4e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:04.702901 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b4cf9414-0556-4420-8e50-9556b8079f4e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:04.703343 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b4cf9414-0556-4420-8e50-9556b8079f4e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:04.887853 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b4cf9414-0556-4420-8e50-9556b8079f4e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:04.896419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b4cf9414-0556-4420-8e50-9556b8079f4e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:04.897931 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b4cf9414-0556-4420-8e50-9556b8079f4e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:04.899323 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-b4cf9414-0556-4420-8e50-9556b8079f4e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.211311 Jun 15 14:44:04.900334 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 81/164] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:04 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:05.038836 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-0851b35d-a855-408d-9233-f156cf35ae2d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:05.039942 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-0851b35d-a855-408d-9233-f156cf35ae2d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:05.052010 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0851b35d-a855-408d-9233-f156cf35ae2d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:05.052799 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0851b35d-a855-408d-9233-f156cf35ae2d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:05.054178 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0851b35d-a855-408d-9233-f156cf35ae2d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:05.054967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0851b35d-a855-408d-9233-f156cf35ae2d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:05.290303 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-0851b35d-a855-408d-9233-f156cf35ae2d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:05.292600 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-afceb29e-74e5-494b-acdd-17ed8cc6d614 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:05.298234 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-afceb29e-74e5-494b-acdd-17ed8cc6d614 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:05.300649 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-0851b35d-a855-408d-9233-f156cf35ae2d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1363 microversion: 2.1 time: 0.268861 Jun 15 14:44:05.301592 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 84/165] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:05 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1363 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:05.329976 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-afceb29e-74e5-494b-acdd-17ed8cc6d614 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:05.333318 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-afceb29e-74e5-494b-acdd-17ed8cc6d614 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:05.335314 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-afceb29e-74e5-494b-acdd-17ed8cc6d614 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:05.338139 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-afceb29e-74e5-494b-acdd-17ed8cc6d614 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:05.554864 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-afceb29e-74e5-494b-acdd-17ed8cc6d614 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:05.562465 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-afceb29e-74e5-494b-acdd-17ed8cc6d614 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.277427 Jun 15 14:44:05.563113 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 82/166] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:05 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:05.922067 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-ad461ea4-bef1-416a-bce6-bfc2f07cfcf6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:05.923010 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-ad461ea4-bef1-416a-bce6-bfc2f07cfcf6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:05.952103 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ad461ea4-bef1-416a-bce6-bfc2f07cfcf6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:05.952810 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ad461ea4-bef1-416a-bce6-bfc2f07cfcf6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:05.953599 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ad461ea4-bef1-416a-bce6-bfc2f07cfcf6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:05.954063 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ad461ea4-bef1-416a-bce6-bfc2f07cfcf6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:06.196244 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ad461ea4-bef1-416a-bce6-bfc2f07cfcf6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:06.208131 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ad461ea4-bef1-416a-bce6-bfc2f07cfcf6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:06.209709 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ad461ea4-bef1-416a-bce6-bfc2f07cfcf6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:06.215022 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-ad461ea4-bef1-416a-bce6-bfc2f07cfcf6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.301057 Jun 15 14:44:06.230199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 85/167] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:05 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:06.316332 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0d5578ef-c360-4856-8136-8c810f60fdc3 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:06.316950 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-0d5578ef-c360-4856-8136-8c810f60fdc3 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:06.329834 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0d5578ef-c360-4856-8136-8c810f60fdc3 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:06.330291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0d5578ef-c360-4856-8136-8c810f60fdc3 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:06.331073 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0d5578ef-c360-4856-8136-8c810f60fdc3 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:06.331509 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0d5578ef-c360-4856-8136-8c810f60fdc3 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:06.548404 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0d5578ef-c360-4856-8136-8c810f60fdc3 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:06.559664 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-0d5578ef-c360-4856-8136-8c810f60fdc3 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1363 microversion: 2.1 time: 0.247026 Jun 15 14:44:06.560245 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 83/168] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:06 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:06.581919 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-23622a1d-755e-407c-aa13-d0f0e946707b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:06.582542 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-23622a1d-755e-407c-aa13-d0f0e946707b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:06.588869 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-23622a1d-755e-407c-aa13-d0f0e946707b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:06.589325 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-23622a1d-755e-407c-aa13-d0f0e946707b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:06.590122 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-23622a1d-755e-407c-aa13-d0f0e946707b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:06.590556 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-23622a1d-755e-407c-aa13-d0f0e946707b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:06.751657 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-23622a1d-755e-407c-aa13-d0f0e946707b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:06.760902 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-23622a1d-755e-407c-aa13-d0f0e946707b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.185317 Jun 15 14:44:06.761790 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 86/169] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:06 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:07.236793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-1a233e0d-e530-4fe1-a70b-97dd9730e88b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:07.237756 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-1a233e0d-e530-4fe1-a70b-97dd9730e88b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:07.245531 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1a233e0d-e530-4fe1-a70b-97dd9730e88b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:07.247288 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1a233e0d-e530-4fe1-a70b-97dd9730e88b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:07.250054 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1a233e0d-e530-4fe1-a70b-97dd9730e88b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:07.250827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1a233e0d-e530-4fe1-a70b-97dd9730e88b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:07.435130 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-1a233e0d-e530-4fe1-a70b-97dd9730e88b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:07.448975 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-1a233e0d-e530-4fe1-a70b-97dd9730e88b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:07.450721 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-1a233e0d-e530-4fe1-a70b-97dd9730e88b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:07.454098 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-1a233e0d-e530-4fe1-a70b-97dd9730e88b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.222465 Jun 15 14:44:07.470904 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 84/170] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:07 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:07.576946 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-68b5aa70-bd5a-4ff9-b445-964913cb2819 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:07.577968 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-68b5aa70-bd5a-4ff9-b445-964913cb2819 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:07.589192 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-68b5aa70-bd5a-4ff9-b445-964913cb2819 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:07.589649 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-68b5aa70-bd5a-4ff9-b445-964913cb2819 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:07.592645 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-68b5aa70-bd5a-4ff9-b445-964913cb2819 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:07.594798 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-68b5aa70-bd5a-4ff9-b445-964913cb2819 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:07.783809 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c4086475-1851-4f9b-9d9d-8073a16ad35b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:07.784440 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c4086475-1851-4f9b-9d9d-8073a16ad35b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:07.797809 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-68b5aa70-bd5a-4ff9-b445-964913cb2819 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:07.805077 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c4086475-1851-4f9b-9d9d-8073a16ad35b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:07.806841 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c4086475-1851-4f9b-9d9d-8073a16ad35b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:07.807490 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-68b5aa70-bd5a-4ff9-b445-964913cb2819 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1363 microversion: 2.1 time: 0.234476 Jun 15 14:44:07.808070 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 87/171] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:07 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:07.817845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c4086475-1851-4f9b-9d9d-8073a16ad35b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:07.817845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c4086475-1851-4f9b-9d9d-8073a16ad35b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:08.324919 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c4086475-1851-4f9b-9d9d-8073a16ad35b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:08.340160 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-c4086475-1851-4f9b-9d9d-8073a16ad35b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.566071 Jun 15 14:44:08.352904 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 85/172] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:07 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:08.481266 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-26f6758b-9c2c-4d62-8510-2113379fc881 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:08.482071 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-26f6758b-9c2c-4d62-8510-2113379fc881 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:08.491113 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-26f6758b-9c2c-4d62-8510-2113379fc881 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:08.491852 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-26f6758b-9c2c-4d62-8510-2113379fc881 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:08.492731 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-26f6758b-9c2c-4d62-8510-2113379fc881 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:08.493321 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-26f6758b-9c2c-4d62-8510-2113379fc881 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:08.828699 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-445782f5-a3e4-4d76-bd33-1d79f40bac71 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:08.836528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-26f6758b-9c2c-4d62-8510-2113379fc881 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:08.838337 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-445782f5-a3e4-4d76-bd33-1d79f40bac71 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:08.848081 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-26f6758b-9c2c-4d62-8510-2113379fc881 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:08.856742 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-26f6758b-9c2c-4d62-8510-2113379fc881 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:08.858923 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-26f6758b-9c2c-4d62-8510-2113379fc881 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.384439 Jun 15 14:44:08.861915 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 88/173] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:08 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:08.866806 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-445782f5-a3e4-4d76-bd33-1d79f40bac71 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:08.867458 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-445782f5-a3e4-4d76-bd33-1d79f40bac71 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:08.870501 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-445782f5-a3e4-4d76-bd33-1d79f40bac71 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:08.874276 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-445782f5-a3e4-4d76-bd33-1d79f40bac71 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:09.270371 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-445782f5-a3e4-4d76-bd33-1d79f40bac71 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:09.280088 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-445782f5-a3e4-4d76-bd33-1d79f40bac71 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1550 microversion: 2.1 time: 0.459317 Jun 15 14:44:09.282287 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 86/174] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:08 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1550 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:09.300170 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1ba3af86-cf30-47f5-b9ce-fb36f801fc1e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:09.300632 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1ba3af86-cf30-47f5-b9ce-fb36f801fc1e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:09.309527 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1ba3af86-cf30-47f5-b9ce-fb36f801fc1e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:09.311475 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1ba3af86-cf30-47f5-b9ce-fb36f801fc1e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:09.316971 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1ba3af86-cf30-47f5-b9ce-fb36f801fc1e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:09.318269 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1ba3af86-cf30-47f5-b9ce-fb36f801fc1e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:09.359097 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f8dcf115-b3f2-4231-b924-17a460d054bb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:09.359720 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f8dcf115-b3f2-4231-b924-17a460d054bb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:09.371074 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f8dcf115-b3f2-4231-b924-17a460d054bb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:09.371543 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f8dcf115-b3f2-4231-b924-17a460d054bb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:09.372337 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f8dcf115-b3f2-4231-b924-17a460d054bb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:09.373761 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f8dcf115-b3f2-4231-b924-17a460d054bb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:09.513018 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-1ba3af86-cf30-47f5-b9ce-fb36f801fc1e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.217388 Jun 15 14:44:09.526627 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 89/175] 10.222.0.57 () {58 vars in 1274 bytes} [Wed Jun 15 14:44:09 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b/os-interface => generated 285 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:44:09.874274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f8dcf115-b3f2-4231-b924-17a460d054bb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:09.880164 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-e3f2ec8d-b645-4722-8a0f-10efecd0dd4f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:09.880778 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-e3f2ec8d-b645-4722-8a0f-10efecd0dd4f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:09.886728 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f8dcf115-b3f2-4231-b924-17a460d054bb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.531624 Jun 15 14:44:09.898997 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 87/176] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:09 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:09.899128 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e3f2ec8d-b645-4722-8a0f-10efecd0dd4f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:09.899712 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e3f2ec8d-b645-4722-8a0f-10efecd0dd4f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:09.901170 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e3f2ec8d-b645-4722-8a0f-10efecd0dd4f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:09.902807 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e3f2ec8d-b645-4722-8a0f-10efecd0dd4f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:10.237899 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e3f2ec8d-b645-4722-8a0f-10efecd0dd4f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:10.261990 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e3f2ec8d-b645-4722-8a0f-10efecd0dd4f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:10.264025 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e3f2ec8d-b645-4722-8a0f-10efecd0dd4f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:10.265171 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-e3f2ec8d-b645-4722-8a0f-10efecd0dd4f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.389644 Jun 15 14:44:10.271926 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 90/177] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:09 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:44:10.906734 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3df40b8f-388a-464c-ac0f-d58287c54742 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:10.909996 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-3df40b8f-388a-464c-ac0f-d58287c54742 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:10.924510 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3df40b8f-388a-464c-ac0f-d58287c54742 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:10.925698 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3df40b8f-388a-464c-ac0f-d58287c54742 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:10.927098 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3df40b8f-388a-464c-ac0f-d58287c54742 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:10.927749 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3df40b8f-388a-464c-ac0f-d58287c54742 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:11.276757 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-3df40b8f-388a-464c-ac0f-d58287c54742 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:11.287579 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-92d363ed-26dd-4d1f-b924-285a0184a306 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:11.290684 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-92d363ed-26dd-4d1f-b924-285a0184a306 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:11.309990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-3df40b8f-388a-464c-ac0f-d58287c54742 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1321 microversion: 2.1 time: 0.408020 Jun 15 14:44:11.313406 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 88/178] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:10 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1321 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:11.321173 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-92d363ed-26dd-4d1f-b924-285a0184a306 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:11.327668 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-92d363ed-26dd-4d1f-b924-285a0184a306 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:11.332264 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-92d363ed-26dd-4d1f-b924-285a0184a306 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:11.333265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-92d363ed-26dd-4d1f-b924-285a0184a306 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:11.338056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-28af5950-5fac-4a3f-b5af-384887f46541 req-312cd2ff-dee1-47e8-8f2c-65c0a6d7794f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123ea48b-cb21-429c-85c6-0ae71d51c1c0", "name": "network-vif-plugged", "status": "completed", "tag": "3b30c106-589d-4777-be4f-8c3b882d514e"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:44:11.374815 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-28af5950-5fac-4a3f-b5af-384887f46541 req-312cd2ff-dee1-47e8-8f2c-65c0a6d7794f service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:11.378293 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-28af5950-5fac-4a3f-b5af-384887f46541 req-312cd2ff-dee1-47e8-8f2c-65c0a6d7794f service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:11.428417 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-28af5950-5fac-4a3f-b5af-384887f46541 req-312cd2ff-dee1-47e8-8f2c-65c0a6d7794f service nova] Creating event network-vif-plugged:3b30c106-589d-4777-be4f-8c3b882d514e for instance 123ea48b-cb21-429c-85c6-0ae71d51c1c0 on hv-cinder-84327 Jun 15 14:44:11.442118 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-28af5950-5fac-4a3f-b5af-384887f46541 req-312cd2ff-dee1-47e8-8f2c-65c0a6d7794f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121773 Jun 15 14:44:11.443554 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 89/179] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:44:11.930534 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-92d363ed-26dd-4d1f-b924-285a0184a306 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:11.954331 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-92d363ed-26dd-4d1f-b924-285a0184a306 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:11.956364 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-92d363ed-26dd-4d1f-b924-285a0184a306 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:11.965633 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-92d363ed-26dd-4d1f-b924-285a0184a306 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.683011 Jun 15 14:44:11.971399 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 91/180] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:11 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:44:12.330395 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0c007bff-b7ac-4dfa-984c-bb6819cd1843 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:12.331152 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-0c007bff-b7ac-4dfa-984c-bb6819cd1843 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:12.358614 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0c007bff-b7ac-4dfa-984c-bb6819cd1843 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:12.370728 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0c007bff-b7ac-4dfa-984c-bb6819cd1843 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:12.374133 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0c007bff-b7ac-4dfa-984c-bb6819cd1843 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:12.382288 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0c007bff-b7ac-4dfa-984c-bb6819cd1843 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:12.708935 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-642d65f4-7463-4e85-b770-7b0db8ec2382 req-6b3a000d-d0b3-41e2-9de5-e5adce980a28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "401c9feb-30ca-4df6-9fba-0a05da5dce7b", "tag": "fb5c9876-5726-466e-a543-a3f84f0df112"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:44:12.720974 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-642d65f4-7463-4e85-b770-7b0db8ec2382 req-6b3a000d-d0b3-41e2-9de5-e5adce980a28 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:12.729769 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-642d65f4-7463-4e85-b770-7b0db8ec2382 req-6b3a000d-d0b3-41e2-9de5-e5adce980a28 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:12.766272 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-642d65f4-7463-4e85-b770-7b0db8ec2382 req-6b3a000d-d0b3-41e2-9de5-e5adce980a28 service nova] Creating event network-changed:fb5c9876-5726-466e-a543-a3f84f0df112 for instance 401c9feb-30ca-4df6-9fba-0a05da5dce7b on hv-cinder-84327 Jun 15 14:44:12.777136 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-642d65f4-7463-4e85-b770-7b0db8ec2382 req-6b3a000d-d0b3-41e2-9de5-e5adce980a28 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072397 Jun 15 14:44:12.780570 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 92/181] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:44:12.986410 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-44c4c523-b46e-408f-b5c9-ff65cc46a6b2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:12.987152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-44c4c523-b46e-408f-b5c9-ff65cc46a6b2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:12.991205 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=92 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:12.997340 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-44c4c523-b46e-408f-b5c9-ff65cc46a6b2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:12.998411 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-44c4c523-b46e-408f-b5c9-ff65cc46a6b2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:13.004962 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-44c4c523-b46e-408f-b5c9-ff65cc46a6b2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:13.007022 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-44c4c523-b46e-408f-b5c9-ff65cc46a6b2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:13.039138 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0c007bff-b7ac-4dfa-984c-bb6819cd1843 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:13.052982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-0c007bff-b7ac-4dfa-984c-bb6819cd1843 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1514 microversion: 2.1 time: 0.727827 Jun 15 14:44:13.055477 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 90/182] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:12 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1514 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:13.075314 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e1185752-e876-4fd7-b19e-9b5c89f9a822 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:44:13.076835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-e1185752-e876-4fd7-b19e-9b5c89f9a822 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:13.087275 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e1185752-e876-4fd7-b19e-9b5c89f9a822 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:13.090085 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e1185752-e876-4fd7-b19e-9b5c89f9a822 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:13.091076 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e1185752-e876-4fd7-b19e-9b5c89f9a822 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:13.091730 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e1185752-e876-4fd7-b19e-9b5c89f9a822 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:13.145411 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.objects.instance [None req-e1185752-e876-4fd7-b19e-9b5c89f9a822 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lazy-loading 'flavor' on Instance uuid 373c3c82-91e0-4d91-8933-c2dbe3582fee {{(pid=124219) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:44:13.263980 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-44c4c523-b46e-408f-b5c9-ff65cc46a6b2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:13.280686 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-44c4c523-b46e-408f-b5c9-ff65cc46a6b2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:13.284533 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-44c4c523-b46e-408f-b5c9-ff65cc46a6b2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:13.286975 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-44c4c523-b46e-408f-b5c9-ff65cc46a6b2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.305872 Jun 15 14:44:13.289842 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 93/183] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:12 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:44:13.415663 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-e1185752-e876-4fd7-b19e-9b5c89f9a822 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "POST /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee/action" status: 200 len: 32 microversion: 2.1 time: 0.344135 Jun 15 14:44:13.417338 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 91/184] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 14:44:13 2022] POST /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee/action => generated 32 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 15 14:44:13.434950 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-ef4a9dc4-eaea-4c3e-adcc-dcacaf1cee0a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:13.437598 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-ef4a9dc4-eaea-4c3e-adcc-dcacaf1cee0a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:13.456965 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ef4a9dc4-eaea-4c3e-adcc-dcacaf1cee0a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:13.458511 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ef4a9dc4-eaea-4c3e-adcc-dcacaf1cee0a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:13.463373 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ef4a9dc4-eaea-4c3e-adcc-dcacaf1cee0a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:13.465142 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ef4a9dc4-eaea-4c3e-adcc-dcacaf1cee0a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:13.492094 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-04c916a5-a91c-4d0a-a26d-8982b333ee0d req-4f6ca996-c325-43cd-bbdf-f81c8baf0a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24657b06-5ef6-429a-bce1-db0da36fea71", "name": "network-vif-plugged", "status": "completed", "tag": "31dbb14f-e111-495f-87c5-4ba2c1afb4a7"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:44:13.535006 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-04c916a5-a91c-4d0a-a26d-8982b333ee0d req-4f6ca996-c325-43cd-bbdf-f81c8baf0a39 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:13.542665 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-04c916a5-a91c-4d0a-a26d-8982b333ee0d req-4f6ca996-c325-43cd-bbdf-f81c8baf0a39 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:13.568894 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-04c916a5-a91c-4d0a-a26d-8982b333ee0d req-4f6ca996-c325-43cd-bbdf-f81c8baf0a39 service nova] Creating event network-vif-plugged:31dbb14f-e111-495f-87c5-4ba2c1afb4a7 for instance 24657b06-5ef6-429a-bce1-db0da36fea71 on hv-cinder-84327 Jun 15 14:44:13.598990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-04c916a5-a91c-4d0a-a26d-8982b333ee0d req-4f6ca996-c325-43cd-bbdf-f81c8baf0a39 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110160 Jun 15 14:44:13.604078 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 92/185] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:44:13.984762 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ef4a9dc4-eaea-4c3e-adcc-dcacaf1cee0a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:13.996673 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-ef4a9dc4-eaea-4c3e-adcc-dcacaf1cee0a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.563979 Jun 15 14:44:14.000345 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 94/186] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:13 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:14.309731 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e6b2febe-c68e-4107-8a65-8664d5e6372f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:14.310646 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-e6b2febe-c68e-4107-8a65-8664d5e6372f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:14.321092 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e6b2febe-c68e-4107-8a65-8664d5e6372f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:14.321555 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e6b2febe-c68e-4107-8a65-8664d5e6372f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:14.322369 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e6b2febe-c68e-4107-8a65-8664d5e6372f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:14.322811 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e6b2febe-c68e-4107-8a65-8664d5e6372f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:14.391864 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:14.996833 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e6b2febe-c68e-4107-8a65-8664d5e6372f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:15.012672 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e6b2febe-c68e-4107-8a65-8664d5e6372f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:15.019639 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-e17cdeeb-53a6-4177-875a-85fdd12033c5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:15.020402 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-e17cdeeb-53a6-4177-875a-85fdd12033c5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:15.034600 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e6b2febe-c68e-4107-8a65-8664d5e6372f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:15.034600 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-e6b2febe-c68e-4107-8a65-8664d5e6372f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1406 microversion: 2.20 time: 0.723515 Jun 15 14:44:15.034600 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 93/187] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:14 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1406 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:15.055404 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e17cdeeb-53a6-4177-875a-85fdd12033c5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:15.058548 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e17cdeeb-53a6-4177-875a-85fdd12033c5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:15.072663 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e17cdeeb-53a6-4177-875a-85fdd12033c5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:15.075057 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e17cdeeb-53a6-4177-875a-85fdd12033c5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:15.306937 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e17cdeeb-53a6-4177-875a-85fdd12033c5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:15.318146 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-e17cdeeb-53a6-4177-875a-85fdd12033c5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.307305 Jun 15 14:44:15.320040 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 95/188] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:15 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:16.051435 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0c37a433-fe03-495c-9efd-b0339685ca06 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:16.052174 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-0c37a433-fe03-495c-9efd-b0339685ca06 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:16.061378 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0c37a433-fe03-495c-9efd-b0339685ca06 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:16.061820 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0c37a433-fe03-495c-9efd-b0339685ca06 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:16.062600 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0c37a433-fe03-495c-9efd-b0339685ca06 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:16.063039 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0c37a433-fe03-495c-9efd-b0339685ca06 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:16.337583 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-9f4ff26f-fa3a-41b7-9d55-e6882ceba776 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:16.338514 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-9f4ff26f-fa3a-41b7-9d55-e6882ceba776 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:16.359901 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9f4ff26f-fa3a-41b7-9d55-e6882ceba776 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:16.360861 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9f4ff26f-fa3a-41b7-9d55-e6882ceba776 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:16.361910 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9f4ff26f-fa3a-41b7-9d55-e6882ceba776 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:16.362526 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9f4ff26f-fa3a-41b7-9d55-e6882ceba776 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:16.371674 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=100 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:16.580553 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0c37a433-fe03-495c-9efd-b0339685ca06 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:16.595269 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0c37a433-fe03-495c-9efd-b0339685ca06 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:16.599714 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0c37a433-fe03-495c-9efd-b0339685ca06 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:16.603264 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-0c37a433-fe03-495c-9efd-b0339685ca06 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1598 microversion: 2.20 time: 0.557544 Jun 15 14:44:16.604029 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 94/189] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:44:16 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1598 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:16.627144 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-5d07bc55-e80e-49ec-b548-429787f8a070 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:16.627861 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-5d07bc55-e80e-49ec-b548-429787f8a070 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:16.638854 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5d07bc55-e80e-49ec-b548-429787f8a070 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:16.647996 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5d07bc55-e80e-49ec-b548-429787f8a070 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:16.650282 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5d07bc55-e80e-49ec-b548-429787f8a070 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:16.651893 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5d07bc55-e80e-49ec-b548-429787f8a070 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:16.686754 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9f4ff26f-fa3a-41b7-9d55-e6882ceba776 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:16.696645 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-9f4ff26f-fa3a-41b7-9d55-e6882ceba776 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.364066 Jun 15 14:44:16.697875 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 96/190] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:16 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:16.798209 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-5d07bc55-e80e-49ec-b548-429787f8a070 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.173948 Jun 15 14:44:16.798895 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 95/191] 10.222.0.57 () {60 vars in 1315 bytes} [Wed Jun 15 14:44:16 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0/os-interface => generated 284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:44:17.719033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-7ee1788a-54dd-4d46-b24a-430b935ac3dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:17.719697 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-7ee1788a-54dd-4d46-b24a-430b935ac3dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:17.736430 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7ee1788a-54dd-4d46-b24a-430b935ac3dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:17.736898 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7ee1788a-54dd-4d46-b24a-430b935ac3dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:17.737730 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7ee1788a-54dd-4d46-b24a-430b935ac3dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:17.742561 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7ee1788a-54dd-4d46-b24a-430b935ac3dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:18.942737 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-7ee1788a-54dd-4d46-b24a-430b935ac3dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:18.957931 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-7ee1788a-54dd-4d46-b24a-430b935ac3dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 1.247057 Jun 15 14:44:18.959283 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 97/192] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:17 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:19.355861 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-2effcf15-2d5e-4004-89ce-3aace087a4b5 req-afcffd6c-118e-41eb-9ac7-0a7f3e3b69ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "123ea48b-cb21-429c-85c6-0ae71d51c1c0", "tag": "3b30c106-589d-4777-be4f-8c3b882d514e"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:44:19.371758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-2effcf15-2d5e-4004-89ce-3aace087a4b5 req-afcffd6c-118e-41eb-9ac7-0a7f3e3b69ec service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:19.376106 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-2effcf15-2d5e-4004-89ce-3aace087a4b5 req-afcffd6c-118e-41eb-9ac7-0a7f3e3b69ec service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:19.401532 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-2effcf15-2d5e-4004-89ce-3aace087a4b5 req-afcffd6c-118e-41eb-9ac7-0a7f3e3b69ec service nova] Creating event network-changed:3b30c106-589d-4777-be4f-8c3b882d514e for instance 123ea48b-cb21-429c-85c6-0ae71d51c1c0 on hv-cinder-84327 Jun 15 14:44:19.415996 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-2effcf15-2d5e-4004-89ce-3aace087a4b5 req-afcffd6c-118e-41eb-9ac7-0a7f3e3b69ec service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064369 Jun 15 14:44:19.421320 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 96/193] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:44:19.976501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-7a656f2d-1938-47c7-8c77-427574c2b629 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:19.977329 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-7a656f2d-1938-47c7-8c77-427574c2b629 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:19.990218 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7a656f2d-1938-47c7-8c77-427574c2b629 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:19.990693 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7a656f2d-1938-47c7-8c77-427574c2b629 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:19.991666 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7a656f2d-1938-47c7-8c77-427574c2b629 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:19.992275 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7a656f2d-1938-47c7-8c77-427574c2b629 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:20.670256 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-7a656f2d-1938-47c7-8c77-427574c2b629 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:20.686806 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-7a656f2d-1938-47c7-8c77-427574c2b629 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.714264 Jun 15 14:44:20.695953 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 98/194] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:19 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:21.697424 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-ed9f0cb2-02be-434f-ae0b-5f9b36a233ba tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:21.700412 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-ed9f0cb2-02be-434f-ae0b-5f9b36a233ba tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:21.705330 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-02d651d1-7544-443d-b22b-45ae6d3f27c6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:21.707286 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-02d651d1-7544-443d-b22b-45ae6d3f27c6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:21.715738 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ed9f0cb2-02be-434f-ae0b-5f9b36a233ba tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:21.716343 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ed9f0cb2-02be-434f-ae0b-5f9b36a233ba tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:21.719568 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ed9f0cb2-02be-434f-ae0b-5f9b36a233ba tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:21.721821 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ed9f0cb2-02be-434f-ae0b-5f9b36a233ba tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:21.737458 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-02d651d1-7544-443d-b22b-45ae6d3f27c6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:21.743686 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-02d651d1-7544-443d-b22b-45ae6d3f27c6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:21.744821 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-02d651d1-7544-443d-b22b-45ae6d3f27c6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:21.747129 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-02d651d1-7544-443d-b22b-45ae6d3f27c6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:21.777183 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-ed9f0cb2-02be-434f-ae0b-5f9b36a233ba tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Going to try to terminate instance {{(pid=124219) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:44:22.012560 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-ed9f0cb2-02be-434f-ae0b-5f9b36a233ba tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "DELETE /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 204 len: 0 microversion: 2.1 time: 0.317499 Jun 15 14:44:22.015904 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 97/195] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:44:21 2022] DELETE /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:44:22.033217 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-4d0221e9-fe07-4838-997f-9a31d1beb904 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:22.034082 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-4d0221e9-fe07-4838-997f-9a31d1beb904 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:22.041491 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4d0221e9-fe07-4838-997f-9a31d1beb904 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:22.046472 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4d0221e9-fe07-4838-997f-9a31d1beb904 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:22.054574 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4d0221e9-fe07-4838-997f-9a31d1beb904 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:22.055655 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4d0221e9-fe07-4838-997f-9a31d1beb904 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:22.250732 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-02d651d1-7544-443d-b22b-45ae6d3f27c6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:22.263492 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-02d651d1-7544-443d-b22b-45ae6d3f27c6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.562519 Jun 15 14:44:22.266988 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 99/196] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:21 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:22.336151 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-4d0221e9-fe07-4838-997f-9a31d1beb904 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:22.358585 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-4d0221e9-fe07-4838-997f-9a31d1beb904 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1553 microversion: 2.1 time: 0.334978 Jun 15 14:44:22.361228 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 98/197] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:22 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1553 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:23.293839 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-89a2c3f3-bead-42e1-84de-fc6c7c2d1034 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:23.293839 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-89a2c3f3-bead-42e1-84de-fc6c7c2d1034 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:23.309217 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-89a2c3f3-bead-42e1-84de-fc6c7c2d1034 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:23.309893 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-89a2c3f3-bead-42e1-84de-fc6c7c2d1034 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:23.311277 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-89a2c3f3-bead-42e1-84de-fc6c7c2d1034 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:23.311983 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-89a2c3f3-bead-42e1-84de-fc6c7c2d1034 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:23.377409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c49eedef-843f-4bb8-80b2-17d74ff150cd tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:23.378554 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c49eedef-843f-4bb8-80b2-17d74ff150cd tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:23.395934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c49eedef-843f-4bb8-80b2-17d74ff150cd tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:23.396517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c49eedef-843f-4bb8-80b2-17d74ff150cd tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:23.400277 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c49eedef-843f-4bb8-80b2-17d74ff150cd tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:23.401068 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c49eedef-843f-4bb8-80b2-17d74ff150cd tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:23.546915 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-89a2c3f3-bead-42e1-84de-fc6c7c2d1034 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:23.554682 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-89a2c3f3-bead-42e1-84de-fc6c7c2d1034 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.277531 Jun 15 14:44:23.559876 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 100/198] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:23 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:23.807852 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c49eedef-843f-4bb8-80b2-17d74ff150cd tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:23.817418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-c49eedef-843f-4bb8-80b2-17d74ff150cd tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1553 microversion: 2.1 time: 0.445002 Jun 15 14:44:23.825784 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 99/199] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:23 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1553 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:24.583845 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-249ea616-6541-4346-8ab6-f350bbac02b6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:24.583845 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-249ea616-6541-4346-8ab6-f350bbac02b6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:24.601390 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-249ea616-6541-4346-8ab6-f350bbac02b6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:24.603468 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-249ea616-6541-4346-8ab6-f350bbac02b6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:24.604694 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-249ea616-6541-4346-8ab6-f350bbac02b6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:24.605392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-249ea616-6541-4346-8ab6-f350bbac02b6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:24.840151 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-d553ae71-0b91-4a2f-83af-80a919dc30cc tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:24.840764 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-d553ae71-0b91-4a2f-83af-80a919dc30cc tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:24.849144 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:24.852087 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-249ea616-6541-4346-8ab6-f350bbac02b6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:24.853467 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d553ae71-0b91-4a2f-83af-80a919dc30cc tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:24.853944 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d553ae71-0b91-4a2f-83af-80a919dc30cc tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:24.862711 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d553ae71-0b91-4a2f-83af-80a919dc30cc tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:24.863282 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d553ae71-0b91-4a2f-83af-80a919dc30cc tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:24.867236 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-249ea616-6541-4346-8ab6-f350bbac02b6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.293329 Jun 15 14:44:24.869692 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 101/200] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:24 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:25.085196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d553ae71-0b91-4a2f-83af-80a919dc30cc tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:25.097376 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-d553ae71-0b91-4a2f-83af-80a919dc30cc tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1553 microversion: 2.1 time: 0.260983 Jun 15 14:44:25.098630 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 100/201] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:24 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1553 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:25.889132 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c29a6a68-e4e5-4de2-a7fe-c4040326e04f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:25.891071 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-c29a6a68-e4e5-4de2-a7fe-c4040326e04f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:25.904443 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c29a6a68-e4e5-4de2-a7fe-c4040326e04f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:25.906354 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c29a6a68-e4e5-4de2-a7fe-c4040326e04f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:25.907891 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c29a6a68-e4e5-4de2-a7fe-c4040326e04f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:25.910305 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c29a6a68-e4e5-4de2-a7fe-c4040326e04f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:26.117107 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0c7aa972-1567-44d4-8d1e-60e97a4d6181 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:26.118052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-0c7aa972-1567-44d4-8d1e-60e97a4d6181 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:26.135864 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0c7aa972-1567-44d4-8d1e-60e97a4d6181 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:26.136429 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0c7aa972-1567-44d4-8d1e-60e97a4d6181 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:26.137410 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0c7aa972-1567-44d4-8d1e-60e97a4d6181 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:26.137986 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0c7aa972-1567-44d4-8d1e-60e97a4d6181 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:26.181995 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-c29a6a68-e4e5-4de2-a7fe-c4040326e04f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:26.208849 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-c29a6a68-e4e5-4de2-a7fe-c4040326e04f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.328018 Jun 15 14:44:26.228647 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 102/202] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:25 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:26.759553 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0c7aa972-1567-44d4-8d1e-60e97a4d6181 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:26.777935 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-0c7aa972-1567-44d4-8d1e-60e97a4d6181 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1553 microversion: 2.1 time: 0.663376 Jun 15 14:44:26.779690 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 101/203] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:26 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1553 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:27.247966 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a7d9a519-0813-40f0-b300-c225bd6c3876 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:27.249917 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a7d9a519-0813-40f0-b300-c225bd6c3876 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:27.256347 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a7d9a519-0813-40f0-b300-c225bd6c3876 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:27.257260 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a7d9a519-0813-40f0-b300-c225bd6c3876 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:27.258329 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a7d9a519-0813-40f0-b300-c225bd6c3876 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:27.259011 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a7d9a519-0813-40f0-b300-c225bd6c3876 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:27.343056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-d23b5892-408f-4b8b-9cd6-f0681eec3e15 req-0ed659d4-9a15-4687-8ba7-7d0dd9ce6058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c1ec95-3f54-48c5-99d2-004d76ceed87", "name": "network-vif-deleted", "tag": "d3e3b078-39b7-46d0-885a-6c877f026556"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:44:27.361720 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-d23b5892-408f-4b8b-9cd6-f0681eec3e15 req-0ed659d4-9a15-4687-8ba7-7d0dd9ce6058 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:27.362049 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-d23b5892-408f-4b8b-9cd6-f0681eec3e15 req-0ed659d4-9a15-4687-8ba7-7d0dd9ce6058 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:27.394375 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-d23b5892-408f-4b8b-9cd6-f0681eec3e15 req-0ed659d4-9a15-4687-8ba7-7d0dd9ce6058 service nova] Creating event network-vif-deleted:d3e3b078-39b7-46d0-885a-6c877f026556 for instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 on hv-cinder-84327 Jun 15 14:44:27.415383 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-d23b5892-408f-4b8b-9cd6-f0681eec3e15 req-0ed659d4-9a15-4687-8ba7-7d0dd9ce6058 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073044 Jun 15 14:44:27.416462 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 102/204] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:44:27.658118 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a7d9a519-0813-40f0-b300-c225bd6c3876 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:27.672581 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a7d9a519-0813-40f0-b300-c225bd6c3876 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.428609 Jun 15 14:44:27.675688 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 103/205] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:27 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:27.799751 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-1e73267e-1d47-497f-a3bb-07276dc54c9e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:27.800808 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-1e73267e-1d47-497f-a3bb-07276dc54c9e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:27.809421 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1e73267e-1d47-497f-a3bb-07276dc54c9e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:27.811904 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1e73267e-1d47-497f-a3bb-07276dc54c9e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:27.813440 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1e73267e-1d47-497f-a3bb-07276dc54c9e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:27.814096 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1e73267e-1d47-497f-a3bb-07276dc54c9e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:27.914694 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-1e73267e-1d47-497f-a3bb-07276dc54c9e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:27.923798 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-1e73267e-1d47-497f-a3bb-07276dc54c9e tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1345 microversion: 2.1 time: 0.131482 Jun 15 14:44:27.924784 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 103/206] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:27 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1345 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:28.702458 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-05c2546b-6a42-4f27-b919-54c19cf74e87 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:28.703098 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-05c2546b-6a42-4f27-b919-54c19cf74e87 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:28.710504 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-05c2546b-6a42-4f27-b919-54c19cf74e87 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:28.710955 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-05c2546b-6a42-4f27-b919-54c19cf74e87 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:28.711987 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-05c2546b-6a42-4f27-b919-54c19cf74e87 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:28.712414 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-05c2546b-6a42-4f27-b919-54c19cf74e87 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:28.942080 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-6210c5d5-9a1c-480e-8cd6-e6e33f63b936 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:28.944908 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-6210c5d5-9a1c-480e-8cd6-e6e33f63b936 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:28.958653 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6210c5d5-9a1c-480e-8cd6-e6e33f63b936 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:28.959355 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6210c5d5-9a1c-480e-8cd6-e6e33f63b936 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:28.960352 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6210c5d5-9a1c-480e-8cd6-e6e33f63b936 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:28.961947 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6210c5d5-9a1c-480e-8cd6-e6e33f63b936 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:28.984907 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-05c2546b-6a42-4f27-b919-54c19cf74e87 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:29.000058 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-05c2546b-6a42-4f27-b919-54c19cf74e87 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.298220 Jun 15 14:44:29.001688 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 104/207] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:28 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:29.018181 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6210c5d5-9a1c-480e-8cd6-e6e33f63b936 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:29.018864 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6210c5d5-9a1c-480e-8cd6-e6e33f63b936 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:29.019861 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.objects.instance [None req-6210c5d5-9a1c-480e-8cd6-e6e33f63b936 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lazy-loading 'fault' on Instance uuid 61c1ec95-3f54-48c5-99d2-004d76ceed87 {{(pid=124219) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:44:29.078317 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-6210c5d5-9a1c-480e-8cd6-e6e33f63b936 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05add5effa924b908fc522cb16f8387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4caa81d58a4daf90980e624d1c2526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:29.089268 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-6210c5d5-9a1c-480e-8cd6-e6e33f63b936 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 200 len: 1350 microversion: 2.1 time: 0.151462 Jun 15 14:44:29.091358 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 104/208] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:28 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 1350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:30.017537 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-2c117886-bb57-4a82-b41c-7b22b6fd671a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:30.021736 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-2c117886-bb57-4a82-b41c-7b22b6fd671a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:30.033554 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2c117886-bb57-4a82-b41c-7b22b6fd671a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:30.034304 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2c117886-bb57-4a82-b41c-7b22b6fd671a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:30.035675 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2c117886-bb57-4a82-b41c-7b22b6fd671a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:30.047064 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2c117886-bb57-4a82-b41c-7b22b6fd671a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:30.109204 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-bcb0ff54-4e53-4ebf-a727-387f8bcbbd47 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:30.111518 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-bcb0ff54-4e53-4ebf-a727-387f8bcbbd47 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:30.120167 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bcb0ff54-4e53-4ebf-a727-387f8bcbbd47 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:30.121002 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bcb0ff54-4e53-4ebf-a727-387f8bcbbd47 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:30.121984 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bcb0ff54-4e53-4ebf-a727-387f8bcbbd47 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:30.124089 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bcb0ff54-4e53-4ebf-a727-387f8bcbbd47 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:30.150369 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-bcb0ff54-4e53-4ebf-a727-387f8bcbbd47 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] HTTP exception thrown: Instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 could not be found. Jun 15 14:44:30.164712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-bcb0ff54-4e53-4ebf-a727-387f8bcbbd47 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Request method failure captured: Jun 15 14:44:30.164712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 HTTP/1.1 Jun 15 14:44:30.164712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:44:30.164712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:44:30.164712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:44:30.164712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:44:30.164712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:44:30.164712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:44:30.164712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:44:30.164712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:44:30.164712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqe_4dZ4GyWOtueftuYZEi-cvmwxvN-vYGFmkNb7BPZnCK0Ib-Lf01kn0cNHeAewrKSrGVGb-HyhvRtexneGPTSBPF3qMjkNglLfGvvc3-CyBb1ctcQxYw0efojdOV2JCMfiAPEVXjEqq0rD6p9H7A4GS61pzD1RjjXgGgeAE_185ePk Jun 15 14:44:30.164712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:44:30.164712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:44:30.164712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:44:30.164712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:44:30.164712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:44:30.164712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:44:30.164712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 3f4caa81d58a4daf90980e624d1c2526 Jun 15 14:44:30.164712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-DeleteServersTestJSON-1602935959 Jun 15 14:44:30.164712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:44:30.164712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:44:30.166754 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3f4caa81d58a4daf90980e624d1c2526"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3f4caa81d58a4daf90980e624d1c2526", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3f4caa81d58a4daf90980e624d1c2526"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3f4caa81d58a4daf90980e624d1c2526"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:44:30.166754 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-DeleteServersTestJSON-1602935959 Jun 15 14:44:30.166754 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 3f4caa81d58a4daf90980e624d1c2526 Jun 15 14:44:30.166754 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602935959 Jun 15 14:44:30.166754 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-DeleteServersTestJSON-1602935959-project Jun 15 14:44:30.166754 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:44:30.166754 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:44:30.166754 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 05add5effa924b908fc522cb16f8387c Jun 15 14:44:30.166754 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-DeleteServersTestJSON-1602935959-project Jun 15 14:44:30.166754 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:44:30.166754 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 could not be found. Jun 15 14:44:30.166754 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': '61c1ec95-3f54-48c5-99d2-004d76ceed87'} Jun 15 14:44:30.167596 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:44:30.167596 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:30.167596 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:44:30.167596 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:44:30.167596 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:44:30.167596 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:44:30.167596 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:44:30.167596 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:44:30.167596 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:44:30.167596 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:44:30.167596 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 could not be found. Jun 15 14:44:30.167596 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:44:30.167596 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:30.167596 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:44:30.167596 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:30.167596 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:30.167596 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:30.167596 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:44:30.167596 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:44:30.167596 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:44:30.168973 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:44:30.168973 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:44:30.168973 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:44:30.168973 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:44:30.168973 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:44:30.168973 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:44:30.168973 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:44:30.168973 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 could not be found. Jun 15 14:44:30.168973 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:44:30.168973 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:30.168973 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:44:30.168973 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:30.168973 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:30.168973 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:30.168973 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:44:30.168973 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:44:30.168973 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 could not be found. Jun 15 14:44:30.168973 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:44:30.170557 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-bcb0ff54-4e53-4ebf-a727-387f8bcbbd47 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Returning 404 to user: Instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:44:30.172281 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-bcb0ff54-4e53-4ebf-a727-387f8bcbbd47 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 404 len: 111 microversion: 2.1 time: 0.068072 Jun 15 14:44:30.180956 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 105/209] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:30 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:44:30.464763 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-2c117886-bb57-4a82-b41c-7b22b6fd671a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:30.482447 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-2c117886-bb57-4a82-b41c-7b22b6fd671a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.468812 Jun 15 14:44:30.487273 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 105/210] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:30 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:30.735527 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-4c35bbcb-3f6b-418b-9096-6db2a4e145d3 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:30.738258 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-4c35bbcb-3f6b-418b-9096-6db2a4e145d3 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:30.755304 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4c35bbcb-3f6b-418b-9096-6db2a4e145d3 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:30.756744 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4c35bbcb-3f6b-418b-9096-6db2a4e145d3 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:30.757538 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4c35bbcb-3f6b-418b-9096-6db2a4e145d3 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:30.758001 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4c35bbcb-3f6b-418b-9096-6db2a4e145d3 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:30.787059 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-4c35bbcb-3f6b-418b-9096-6db2a4e145d3 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] HTTP exception thrown: Instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 could not be found. Jun 15 14:44:30.801985 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-4c35bbcb-3f6b-418b-9096-6db2a4e145d3 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Request method failure captured: Jun 15 14:44:30.801985 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87/os-volume_attachments HTTP/1.1 Jun 15 14:44:30.801985 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:44:30.801985 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:44:30.801985 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:44:30.801985 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:44:30.801985 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:44:30.801985 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:44:30.801985 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:44:30.801985 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:44:30.801985 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqe_4dZ4GyWOtueftuYZEi-cvmwxvN-vYGFmkNb7BPZnCK0Ib-Lf01kn0cNHeAewrKSrGVGb-HyhvRtexneGPTSBPF3qMjkNglLfGvvc3-CyBb1ctcQxYw0efojdOV2JCMfiAPEVXjEqq0rD6p9H7A4GS61pzD1RjjXgGgeAE_185ePk Jun 15 14:44:30.801985 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:44:30.801985 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:44:30.801985 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:44:30.801985 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:44:30.801985 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:44:30.801985 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:44:30.801985 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 3f4caa81d58a4daf90980e624d1c2526 Jun 15 14:44:30.801985 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-DeleteServersTestJSON-1602935959 Jun 15 14:44:30.801985 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:44:30.801985 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:44:30.803322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3f4caa81d58a4daf90980e624d1c2526"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3f4caa81d58a4daf90980e624d1c2526", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3f4caa81d58a4daf90980e624d1c2526"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3f4caa81d58a4daf90980e624d1c2526"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:44:30.803322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-DeleteServersTestJSON-1602935959 Jun 15 14:44:30.803322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 3f4caa81d58a4daf90980e624d1c2526 Jun 15 14:44:30.803322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602935959 Jun 15 14:44:30.803322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-DeleteServersTestJSON-1602935959-project Jun 15 14:44:30.803322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:44:30.803322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:44:30.803322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 05add5effa924b908fc522cb16f8387c Jun 15 14:44:30.803322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-DeleteServersTestJSON-1602935959-project Jun 15 14:44:30.803322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:44:30.803322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 could not be found. Jun 15 14:44:30.803322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'server_id': '61c1ec95-3f54-48c5-99d2-004d76ceed87'} Jun 15 14:44:30.804027 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:44:30.804027 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:30.804027 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:44:30.804027 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:44:30.804027 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:44:30.804027 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:44:30.804027 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:44:30.804027 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:44:30.804027 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:44:30.804027 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:44:30.804027 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 could not be found. Jun 15 14:44:30.804027 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:44:30.804027 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:30.804027 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:44:30.804027 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:30.804027 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:30.804027 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:30.804027 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:44:30.804027 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:44:30.804027 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:44:30.805319 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:44:30.805319 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 15 14:44:30.805319 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:44:30.805319 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 15 14:44:30.805319 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:44:30.805319 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 15 14:44:30.805319 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 15 14:44:30.805319 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:44:30.805319 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:44:30.805319 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 could not be found. Jun 15 14:44:30.805319 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:44:30.805319 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:30.805319 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:44:30.805319 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:30.805319 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:30.805319 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:30.805319 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:44:30.805319 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:44:30.805319 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 could not be found. Jun 15 14:44:30.805319 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:44:30.806818 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-4c35bbcb-3f6b-418b-9096-6db2a4e145d3 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Returning 404 to user: Instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:44:30.806818 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-4c35bbcb-3f6b-418b-9096-6db2a4e145d3 tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.073123 Jun 15 14:44:30.821753 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 106/211] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 14:44:30 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87/os-volume_attachments => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:44:31.515401 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-239d7197-da8c-49b9-a7a6-5b5f7d6ed62f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:31.516026 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-239d7197-da8c-49b9-a7a6-5b5f7d6ed62f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:31.533323 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-239d7197-da8c-49b9-a7a6-5b5f7d6ed62f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:31.534483 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-239d7197-da8c-49b9-a7a6-5b5f7d6ed62f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:31.535415 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-239d7197-da8c-49b9-a7a6-5b5f7d6ed62f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:31.535995 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-239d7197-da8c-49b9-a7a6-5b5f7d6ed62f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:31.782338 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-239d7197-da8c-49b9-a7a6-5b5f7d6ed62f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:31.795294 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-239d7197-da8c-49b9-a7a6-5b5f7d6ed62f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.284108 Jun 15 14:44:31.798970 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 106/212] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:31 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:32.192198 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-61c95a6f-9471-4635-9e9d-cd5e11f048dd tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:32.192754 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-61c95a6f-9471-4635-9e9d-cd5e11f048dd tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:32.209194 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-61c95a6f-9471-4635-9e9d-cd5e11f048dd tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:32.210052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-61c95a6f-9471-4635-9e9d-cd5e11f048dd tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:32.211130 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-61c95a6f-9471-4635-9e9d-cd5e11f048dd tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:32.212171 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-61c95a6f-9471-4635-9e9d-cd5e11f048dd tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:32.242621 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-61c95a6f-9471-4635-9e9d-cd5e11f048dd tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] HTTP exception thrown: Instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 could not be found. Jun 15 14:44:32.247384 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-61c95a6f-9471-4635-9e9d-cd5e11f048dd tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Request method failure captured: Jun 15 14:44:32.247384 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: DELETE /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 HTTP/1.1 Jun 15 14:44:32.247384 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:44:32.247384 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:44:32.247384 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:44:32.247384 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:44:32.247384 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:44:32.247384 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:44:32.247384 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:44:32.247384 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:44:32.247384 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqe_4dZ4GyWOtueftuYZEi-cvmwxvN-vYGFmkNb7BPZnCK0Ib-Lf01kn0cNHeAewrKSrGVGb-HyhvRtexneGPTSBPF3qMjkNglLfGvvc3-CyBb1ctcQxYw0efojdOV2JCMfiAPEVXjEqq0rD6p9H7A4GS61pzD1RjjXgGgeAE_185ePk Jun 15 14:44:32.247384 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:44:32.247384 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:44:32.247384 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:44:32.247384 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:44:32.247384 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:44:32.247384 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:44:32.247384 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 3f4caa81d58a4daf90980e624d1c2526 Jun 15 14:44:32.247384 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-DeleteServersTestJSON-1602935959 Jun 15 14:44:32.247384 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:44:32.247384 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:44:32.249534 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3f4caa81d58a4daf90980e624d1c2526"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3f4caa81d58a4daf90980e624d1c2526", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3f4caa81d58a4daf90980e624d1c2526"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3f4caa81d58a4daf90980e624d1c2526"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:44:32.249534 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-DeleteServersTestJSON-1602935959 Jun 15 14:44:32.249534 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 3f4caa81d58a4daf90980e624d1c2526 Jun 15 14:44:32.249534 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602935959 Jun 15 14:44:32.249534 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-DeleteServersTestJSON-1602935959-project Jun 15 14:44:32.249534 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:44:32.249534 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:44:32.249534 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 05add5effa924b908fc522cb16f8387c Jun 15 14:44:32.249534 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-DeleteServersTestJSON-1602935959-project Jun 15 14:44:32.249534 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:44:32.249534 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 could not be found. Jun 15 14:44:32.249534 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': '61c1ec95-3f54-48c5-99d2-004d76ceed87'} Jun 15 14:44:32.250419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:44:32.250419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:32.250419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:44:32.250419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:44:32.250419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:44:32.250419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:44:32.250419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:44:32.250419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:44:32.250419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:44:32.250419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:44:32.250419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 could not be found. Jun 15 14:44:32.250419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:44:32.250419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:32.250419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:44:32.250419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:32.250419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:32.250419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:32.250419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:44:32.250419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:44:32.250419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:44:32.251979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:44:32.251979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 14:44:32.251979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 14:44:32.251979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 14:44:32.251979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 14:44:32.251979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:44:32.251979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:44:32.251979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:44:32.251979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:44:32.251979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 could not be found. Jun 15 14:44:32.251979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:44:32.251979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:32.251979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:44:32.251979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:32.251979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:32.251979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:32.251979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:44:32.251979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:44:32.251979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 could not be found. Jun 15 14:44:32.251979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:44:32.256545 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-61c95a6f-9471-4635-9e9d-cd5e11f048dd tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Returning 404 to user: Instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:44:32.257822 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-61c95a6f-9471-4635-9e9d-cd5e11f048dd tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "DELETE /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 404 len: 111 microversion: 2.1 time: 0.070051 Jun 15 14:44:32.261937 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 107/213] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:44:32 2022] DELETE /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:44:32.274148 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-d3b03ed6-81c1-47e9-93ca-21d7a0f2bfff tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:32.275004 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-d3b03ed6-81c1-47e9-93ca-21d7a0f2bfff tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] [instance: 61c1ec95-3f54-48c5-99d2-004d76ceed87] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:32.291398 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d3b03ed6-81c1-47e9-93ca-21d7a0f2bfff tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:32.293091 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d3b03ed6-81c1-47e9-93ca-21d7a0f2bfff tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:32.294067 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d3b03ed6-81c1-47e9-93ca-21d7a0f2bfff tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:32.295791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d3b03ed6-81c1-47e9-93ca-21d7a0f2bfff tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:32.326617 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.wsgi [None req-d3b03ed6-81c1-47e9-93ca-21d7a0f2bfff tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] HTTP exception thrown: Instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 could not be found. Jun 15 14:44:32.362002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-d3b03ed6-81c1-47e9-93ca-21d7a0f2bfff tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Request method failure captured: Jun 15 14:44:32.362002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: request: GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 HTTP/1.1 Jun 15 14:44:32.362002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept: application/json Jun 15 14:44:32.362002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept-Encoding: identity Jun 15 14:44:32.362002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Connection: close Jun 15 14:44:32.362002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Length: 0 Jun 15 14:44:32.362002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Type: application/json Jun 15 14:44:32.362002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Host: 10.222.0.57 Jun 15 14:44:32.362002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Openstack-System-Scope: None Jun 15 14:44:32.362002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: User-Agent: python-urllib3/1.26.9 Jun 15 14:44:32.362002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Auth-Token: gAAAAABiqe_4dZ4GyWOtueftuYZEi-cvmwxvN-vYGFmkNb7BPZnCK0Ib-Lf01kn0cNHeAewrKSrGVGb-HyhvRtexneGPTSBPF3qMjkNglLfGvvc3-CyBb1ctcQxYw0efojdOV2JCMfiAPEVXjEqq0rD6p9H7A4GS61pzD1RjjXgGgeAE_185ePk Jun 15 14:44:32.362002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Id: None Jun 15 14:44:32.362002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Name: None Jun 15 14:44:32.362002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Identity-Status: Confirmed Jun 15 14:44:32.362002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Is-Admin-Project: True Jun 15 14:44:32.362002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Id: default Jun 15 14:44:32.362002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Name: Default Jun 15 14:44:32.362002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Id: 3f4caa81d58a4daf90980e624d1c2526 Jun 15 14:44:32.362002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Name: tempest-DeleteServersTestJSON-1602935959 Jun 15 14:44:32.362002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Role: member,reader Jun 15 14:44:32.362002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Roles: member,reader Jun 15 14:44:32.363230 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3f4caa81d58a4daf90980e624d1c2526"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3f4caa81d58a4daf90980e624d1c2526", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3f4caa81d58a4daf90980e624d1c2526"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3f4caa81d58a4daf90980e624d1c2526"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:44:32.363230 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant: tempest-DeleteServersTestJSON-1602935959 Jun 15 14:44:32.363230 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Id: 3f4caa81d58a4daf90980e624d1c2526 Jun 15 14:44:32.363230 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602935959 Jun 15 14:44:32.363230 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User: tempest-DeleteServersTestJSON-1602935959-project Jun 15 14:44:32.363230 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Id: default Jun 15 14:44:32.363230 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Name: Default Jun 15 14:44:32.363230 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Id: 05add5effa924b908fc522cb16f8387c Jun 15 14:44:32.363230 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Name: tempest-DeleteServersTestJSON-1602935959-project Jun 15 14:44:32.363230 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: method: > Jun 15 14:44:32.363230 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: exception: Instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 could not be found. Jun 15 14:44:32.363230 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: action_args: {'id': '61c1ec95-3f54-48c5-99d2-004d76ceed87'} Jun 15 14:44:32.363868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:44:32.363868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:32.363868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:44:32.363868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:44:32.363868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:44:32.363868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:44:32.363868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:44:32.363868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:44:32.363868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:44:32.363868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:44:32.363868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 could not be found. Jun 15 14:44:32.363868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:44:32.363868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:32.363868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:44:32.363868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:32.363868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:32.363868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:32.363868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:44:32.363868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:44:32.363868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:44:32.364890 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:44:32.364890 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:44:32.364890 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:44:32.364890 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:44:32.364890 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:44:32.364890 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:44:32.364890 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:44:32.364890 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 could not be found. Jun 15 14:44:32.364890 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:44:32.364890 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:44:32.364890 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:44:32.364890 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:44:32.364890 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:44:32.364890 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:44:32.364890 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:44:32.364890 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:44:32.364890 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 could not be found. Jun 15 14:44:32.364890 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:44:32.365871 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-d3b03ed6-81c1-47e9-93ca-21d7a0f2bfff tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] Returning 404 to user: Instance 61c1ec95-3f54-48c5-99d2-004d76ceed87 could not be found. {{(pid=124220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:44:32.365871 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-d3b03ed6-81c1-47e9-93ca-21d7a0f2bfff tempest-DeleteServersTestJSON-1602935959 tempest-DeleteServersTestJSON-1602935959-project] 10.222.0.57 "GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87" status: 404 len: 111 microversion: 2.1 time: 0.100341 Jun 15 14:44:32.371677 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 107/214] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:32 2022] GET /compute/v2.1/servers/61c1ec95-3f54-48c5-99d2-004d76ceed87 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:44:32.816582 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-cb9ecca8-0486-4862-a3e5-042669db7d48 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:32.818207 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-cb9ecca8-0486-4862-a3e5-042669db7d48 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:32.830830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-cb9ecca8-0486-4862-a3e5-042669db7d48 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:32.831751 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-cb9ecca8-0486-4862-a3e5-042669db7d48 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:32.832792 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-cb9ecca8-0486-4862-a3e5-042669db7d48 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:32.833871 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-cb9ecca8-0486-4862-a3e5-042669db7d48 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:33.085921 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-cb9ecca8-0486-4862-a3e5-042669db7d48 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:33.096522 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-cb9ecca8-0486-4862-a3e5-042669db7d48 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.283989 Jun 15 14:44:33.097685 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 108/215] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:32 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:34.121709 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-24127ae2-80fa-4f28-bfd3-bc382b9bbf92 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:34.122541 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-24127ae2-80fa-4f28-bfd3-bc382b9bbf92 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:34.136267 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-24127ae2-80fa-4f28-bfd3-bc382b9bbf92 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:34.137062 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-24127ae2-80fa-4f28-bfd3-bc382b9bbf92 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:34.139054 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-24127ae2-80fa-4f28-bfd3-bc382b9bbf92 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:34.139754 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-24127ae2-80fa-4f28-bfd3-bc382b9bbf92 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:34.340862 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-24127ae2-80fa-4f28-bfd3-bc382b9bbf92 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:34.353610 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-24127ae2-80fa-4f28-bfd3-bc382b9bbf92 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.235887 Jun 15 14:44:34.364810 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 108/216] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:34 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:35.372088 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-4825d211-3c77-4e96-b8e3-2641271d3f96 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:35.374367 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-4825d211-3c77-4e96-b8e3-2641271d3f96 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:35.381434 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4825d211-3c77-4e96-b8e3-2641271d3f96 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:35.382789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4825d211-3c77-4e96-b8e3-2641271d3f96 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:35.384276 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4825d211-3c77-4e96-b8e3-2641271d3f96 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:35.384937 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4825d211-3c77-4e96-b8e3-2641271d3f96 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:35.637718 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-4825d211-3c77-4e96-b8e3-2641271d3f96 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:35.647760 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-4825d211-3c77-4e96-b8e3-2641271d3f96 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.279964 Jun 15 14:44:35.655019 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 109/217] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:35 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:36.672529 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-2e3fe6fa-f2a8-41a5-98b6-96a8a16ffa16 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:36.673146 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-2e3fe6fa-f2a8-41a5-98b6-96a8a16ffa16 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:36.688010 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2e3fe6fa-f2a8-41a5-98b6-96a8a16ffa16 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:36.688480 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2e3fe6fa-f2a8-41a5-98b6-96a8a16ffa16 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:36.689218 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2e3fe6fa-f2a8-41a5-98b6-96a8a16ffa16 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:36.689947 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2e3fe6fa-f2a8-41a5-98b6-96a8a16ffa16 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:36.981007 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-2e3fe6fa-f2a8-41a5-98b6-96a8a16ffa16 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:36.996621 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-2e3fe6fa-f2a8-41a5-98b6-96a8a16ffa16 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.328768 Jun 15 14:44:37.007077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 109/218] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:36 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:38.015092 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-88de6f07-0d82-4ae5-85fb-27f2167f713f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:38.015840 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-88de6f07-0d82-4ae5-85fb-27f2167f713f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:38.027804 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-88de6f07-0d82-4ae5-85fb-27f2167f713f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:38.035219 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-88de6f07-0d82-4ae5-85fb-27f2167f713f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:38.036663 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-88de6f07-0d82-4ae5-85fb-27f2167f713f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:38.038090 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-88de6f07-0d82-4ae5-85fb-27f2167f713f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:38.268012 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-88de6f07-0d82-4ae5-85fb-27f2167f713f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:38.276147 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-88de6f07-0d82-4ae5-85fb-27f2167f713f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.265058 Jun 15 14:44:38.276948 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 110/219] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:38 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:39.294291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-d4c30737-2a04-4ad6-a0c6-27640111e42b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:39.303020 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-d4c30737-2a04-4ad6-a0c6-27640111e42b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:39.321131 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d4c30737-2a04-4ad6-a0c6-27640111e42b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:39.322020 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d4c30737-2a04-4ad6-a0c6-27640111e42b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:39.323257 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d4c30737-2a04-4ad6-a0c6-27640111e42b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:39.323904 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d4c30737-2a04-4ad6-a0c6-27640111e42b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:39.585629 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-d4c30737-2a04-4ad6-a0c6-27640111e42b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:39.609305 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-d4c30737-2a04-4ad6-a0c6-27640111e42b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.319090 Jun 15 14:44:39.614324 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 110/220] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:39 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:40.630033 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-48706c0e-7e07-4b13-887a-e350a2a0d641 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:40.630654 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-48706c0e-7e07-4b13-887a-e350a2a0d641 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:40.643233 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-48706c0e-7e07-4b13-887a-e350a2a0d641 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:40.644087 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-48706c0e-7e07-4b13-887a-e350a2a0d641 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:40.645347 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-48706c0e-7e07-4b13-887a-e350a2a0d641 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:40.645944 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-48706c0e-7e07-4b13-887a-e350a2a0d641 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:40.672272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:41.091163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-48706c0e-7e07-4b13-887a-e350a2a0d641 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:41.102135 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-48706c0e-7e07-4b13-887a-e350a2a0d641 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.476984 Jun 15 14:44:41.102707 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 111/221] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:40 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:42.119991 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-e281b9c9-085e-4c6b-9039-ad398521f3bb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:42.120696 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-e281b9c9-085e-4c6b-9039-ad398521f3bb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:42.128184 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e281b9c9-085e-4c6b-9039-ad398521f3bb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:42.128638 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e281b9c9-085e-4c6b-9039-ad398521f3bb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:42.129414 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e281b9c9-085e-4c6b-9039-ad398521f3bb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:42.129886 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e281b9c9-085e-4c6b-9039-ad398521f3bb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:42.157148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-77f89c23-8fdd-4c4e-8846-04dec7cd5afb tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Action: 'create', calling method: .version_select at 0x7f8f2009d430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1776512588", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGplILBqZ4UiVFNZp/A6lhw74QCpjYRCtN7PwM0FaN0ewzWY0758ELptLoev/159HzZucX1xVMgd5siaJWH2GbHr9fO8gGJhz7HIC47laA4tWiYDnY1ba3WKrnvBbSOv7w=="}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:44:42.172495 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-77f89c23-8fdd-4c4e-8846-04dec7cd5afb tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Getting quotas for project f6fb5fc3024f428d9d052371dbe90737. Resources: {'key_pairs'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:44:42.176423 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-77f89c23-8fdd-4c4e-8846-04dec7cd5afb tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Getting quotas for user 163fb6502e0442c7aefc0c122ed4c035 and project f6fb5fc3024f428d9d052371dbe90737. Resources: {'key_pairs'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:44:42.199989 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-77f89c23-8fdd-4c4e-8846-04dec7cd5afb tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.047247 Jun 15 14:44:42.200592 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 112/222] 10.222.0.57 () {60 vars in 1158 bytes} [Wed Jun 15 14:44:42 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:44:42.270340 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e281b9c9-085e-4c6b-9039-ad398521f3bb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:42.277604 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-e281b9c9-085e-4c6b-9039-ad398521f3bb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.162381 Jun 15 14:44:42.278151 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 111/223] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:42 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:42.304654 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-b96a4a82-0b84-4766-be3a-350c854180aa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1426025589", "imageRef": "f1d05966-7d5b-4f9d-b935-a408cbf1093d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1776512588", "networks": [{"uuid": "3dc3313d-19a7-4767-b469-a539f851d799"}]}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:44:42.358278 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.network.neutron [None req-b96a4a82-0b84-4766-be3a-350c854180aa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] validate_networks() for [('3dc3313d-19a7-4767-b469-a539f851d799', None, None, None, None, None)] {{(pid=124219) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:44:42.753704 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-b96a4a82-0b84-4766-be3a-350c854180aa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Flavor limits 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:44:42.754056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-b96a4a82-0b84-4766-be3a-350c854180aa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Image limits 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:44:42.754807 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-b96a4a82-0b84-4766-be3a-350c854180aa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Flavor pref 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:44:42.755435 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-b96a4a82-0b84-4766-be3a-350c854180aa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Image pref 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:44:42.755852 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-b96a4a82-0b84-4766-be3a-350c854180aa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:44:42.766197 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b96a4a82-0b84-4766-be3a-350c854180aa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:42.766619 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b96a4a82-0b84-4766-be3a-350c854180aa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:42.767850 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b96a4a82-0b84-4766-be3a-350c854180aa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:42.768494 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b96a4a82-0b84-4766-be3a-350c854180aa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:42.787259 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-b96a4a82-0b84-4766-be3a-350c854180aa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Getting quotas for project f6fb5fc3024f428d9d052371dbe90737. Resources: {'cores', 'instances', 'ram'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:44:42.791676 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-b96a4a82-0b84-4766-be3a-350c854180aa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Getting quotas for user 163fb6502e0442c7aefc0c122ed4c035 and project f6fb5fc3024f428d9d052371dbe90737. Resources: {'cores', 'instances', 'ram'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:44:42.806354 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-b96a4a82-0b84-4766-be3a-350c854180aa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Going to run 1 instances... {{(pid=124219) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:44:42.808575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-b96a4a82-0b84-4766-be3a-350c854180aa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1d05966-7d5b-4f9d-b935-a408cbf1093d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124219) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:44:42.861503 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-b96a4a82-0b84-4766-be3a-350c854180aa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560654 Jun 15 14:44:42.866971 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 113/224] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 14:44:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:44:42.874764 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-85cedd0c-b632-4df3-a2ba-6c9540caa194 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:42.875936 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-85cedd0c-b632-4df3-a2ba-6c9540caa194 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:42.941382 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-85cedd0c-b632-4df3-a2ba-6c9540caa194 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:42.949691 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-85cedd0c-b632-4df3-a2ba-6c9540caa194 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1259 microversion: 2.1 time: 0.080432 Jun 15 14:44:42.950405 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 112/225] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:42 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1259 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:43.297427 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-2e42b940-1bff-438f-a177-9de330e50ac8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:43.298156 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-2e42b940-1bff-438f-a177-9de330e50ac8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:43.304269 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2e42b940-1bff-438f-a177-9de330e50ac8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:43.304717 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2e42b940-1bff-438f-a177-9de330e50ac8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:43.305474 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2e42b940-1bff-438f-a177-9de330e50ac8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:43.306004 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2e42b940-1bff-438f-a177-9de330e50ac8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:43.442094 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-2e42b940-1bff-438f-a177-9de330e50ac8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:43.449630 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-2e42b940-1bff-438f-a177-9de330e50ac8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.157181 Jun 15 14:44:43.450230 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 114/226] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:43 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:43.968158 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-51a41351-7572-4eb1-9e97-994d7dcbe5c6 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:43.968778 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-51a41351-7572-4eb1-9e97-994d7dcbe5c6 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:43.970641 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=42 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:43.975814 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-51a41351-7572-4eb1-9e97-994d7dcbe5c6 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:43.976255 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-51a41351-7572-4eb1-9e97-994d7dcbe5c6 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:43.977003 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-51a41351-7572-4eb1-9e97-994d7dcbe5c6 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:43.977432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-51a41351-7572-4eb1-9e97-994d7dcbe5c6 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:44.054716 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-51a41351-7572-4eb1-9e97-994d7dcbe5c6 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:44.069362 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-51a41351-7572-4eb1-9e97-994d7dcbe5c6 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1311 microversion: 2.1 time: 0.105445 Jun 15 14:44:44.070015 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 113/227] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:43 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:44.468458 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-9270e9cb-6a06-4651-8705-fa3f84a3c325 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:44.468458 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-9270e9cb-6a06-4651-8705-fa3f84a3c325 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:44.475486 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9270e9cb-6a06-4651-8705-fa3f84a3c325 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:44.476014 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9270e9cb-6a06-4651-8705-fa3f84a3c325 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:44.476935 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9270e9cb-6a06-4651-8705-fa3f84a3c325 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:44.486033 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9270e9cb-6a06-4651-8705-fa3f84a3c325 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:44.714345 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-9270e9cb-6a06-4651-8705-fa3f84a3c325 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:44.726161 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-9270e9cb-6a06-4651-8705-fa3f84a3c325 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.262780 Jun 15 14:44:44.727021 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 115/228] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:44 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:45.087530 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-0bdf3bb1-42f4-4d64-8ce4-02ae19204132 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:45.088891 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-0bdf3bb1-42f4-4d64-8ce4-02ae19204132 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:45.096053 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0bdf3bb1-42f4-4d64-8ce4-02ae19204132 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:45.096723 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0bdf3bb1-42f4-4d64-8ce4-02ae19204132 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:45.097881 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0bdf3bb1-42f4-4d64-8ce4-02ae19204132 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:45.098467 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0bdf3bb1-42f4-4d64-8ce4-02ae19204132 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:45.117291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=100 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:45.183772 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-0bdf3bb1-42f4-4d64-8ce4-02ae19204132 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:45.195135 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-0bdf3bb1-42f4-4d64-8ce4-02ae19204132 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1317 microversion: 2.1 time: 0.111801 Jun 15 14:44:45.196238 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 114/229] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:45 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1317 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:45.744252 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-4fe663ac-fc90-490a-bd4b-4189690410ad tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:45.745202 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-4fe663ac-fc90-490a-bd4b-4189690410ad tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:45.752809 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4fe663ac-fc90-490a-bd4b-4189690410ad tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:45.753517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4fe663ac-fc90-490a-bd4b-4189690410ad tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:45.754325 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4fe663ac-fc90-490a-bd4b-4189690410ad tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:45.755012 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4fe663ac-fc90-490a-bd4b-4189690410ad tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:45.913920 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-4fe663ac-fc90-490a-bd4b-4189690410ad tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:45.925300 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-4fe663ac-fc90-490a-bd4b-4189690410ad tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.184747 Jun 15 14:44:45.925917 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 116/230] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:45 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:46.213317 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-87aa54be-9c70-4cdd-b6f7-548271525d14 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:46.213875 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-87aa54be-9c70-4cdd-b6f7-548271525d14 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:46.220860 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-87aa54be-9c70-4cdd-b6f7-548271525d14 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:46.221306 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-87aa54be-9c70-4cdd-b6f7-548271525d14 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:46.222183 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-87aa54be-9c70-4cdd-b6f7-548271525d14 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:46.222615 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-87aa54be-9c70-4cdd-b6f7-548271525d14 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:46.360631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-87aa54be-9c70-4cdd-b6f7-548271525d14 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:46.368247 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-87aa54be-9c70-4cdd-b6f7-548271525d14 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1359 microversion: 2.1 time: 0.159323 Jun 15 14:44:46.368914 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 115/231] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:46 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:46.942467 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-4ad5010d-d971-4eab-81c4-31db30c3e492 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:46.943164 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-4ad5010d-d971-4eab-81c4-31db30c3e492 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:46.949937 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4ad5010d-d971-4eab-81c4-31db30c3e492 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:46.950775 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4ad5010d-d971-4eab-81c4-31db30c3e492 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:46.952096 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4ad5010d-d971-4eab-81c4-31db30c3e492 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:46.952650 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4ad5010d-d971-4eab-81c4-31db30c3e492 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:47.114741 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-4ad5010d-d971-4eab-81c4-31db30c3e492 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:47.123926 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-4ad5010d-d971-4eab-81c4-31db30c3e492 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.185086 Jun 15 14:44:47.124591 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 117/232] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:46 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:47.385838 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-2545fd4d-8031-4342-ac39-db2f42e196ce tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:47.387525 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-2545fd4d-8031-4342-ac39-db2f42e196ce tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:47.394432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2545fd4d-8031-4342-ac39-db2f42e196ce tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:47.395111 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2545fd4d-8031-4342-ac39-db2f42e196ce tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:47.396047 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2545fd4d-8031-4342-ac39-db2f42e196ce tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:47.396799 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2545fd4d-8031-4342-ac39-db2f42e196ce tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:47.571518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-2545fd4d-8031-4342-ac39-db2f42e196ce tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:47.579751 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-2545fd4d-8031-4342-ac39-db2f42e196ce tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1359 microversion: 2.1 time: 0.197664 Jun 15 14:44:47.580252 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 116/233] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:47 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:48.144928 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-051649c8-c8f0-4bb8-b56f-1923c32f5775 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:48.145688 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-051649c8-c8f0-4bb8-b56f-1923c32f5775 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:48.164121 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-051649c8-c8f0-4bb8-b56f-1923c32f5775 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:48.164653 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-051649c8-c8f0-4bb8-b56f-1923c32f5775 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:48.165514 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-051649c8-c8f0-4bb8-b56f-1923c32f5775 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:48.166066 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-051649c8-c8f0-4bb8-b56f-1923c32f5775 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:48.314926 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-051649c8-c8f0-4bb8-b56f-1923c32f5775 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:48.322947 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-051649c8-c8f0-4bb8-b56f-1923c32f5775 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.184580 Jun 15 14:44:48.323409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 118/234] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:48 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:48.597572 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-78ce7691-90b3-4d36-b4cc-ae1a6360dbcf tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:48.598336 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-78ce7691-90b3-4d36-b4cc-ae1a6360dbcf tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:48.606201 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-78ce7691-90b3-4d36-b4cc-ae1a6360dbcf tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:48.606955 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-78ce7691-90b3-4d36-b4cc-ae1a6360dbcf tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:48.608330 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-78ce7691-90b3-4d36-b4cc-ae1a6360dbcf tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:48.609018 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-78ce7691-90b3-4d36-b4cc-ae1a6360dbcf tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:48.754589 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-78ce7691-90b3-4d36-b4cc-ae1a6360dbcf tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:48.761914 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-78ce7691-90b3-4d36-b4cc-ae1a6360dbcf tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1359 microversion: 2.1 time: 0.169463 Jun 15 14:44:48.762471 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 117/235] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:48 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:49.343086 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-25b9f796-0408-4f06-8a1d-f1c12fccb838 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:49.343945 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-25b9f796-0408-4f06-8a1d-f1c12fccb838 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:49.352399 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-25b9f796-0408-4f06-8a1d-f1c12fccb838 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:49.352399 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-25b9f796-0408-4f06-8a1d-f1c12fccb838 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:49.355750 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-25b9f796-0408-4f06-8a1d-f1c12fccb838 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:49.356392 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-25b9f796-0408-4f06-8a1d-f1c12fccb838 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:49.510284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-25b9f796-0408-4f06-8a1d-f1c12fccb838 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:49.521889 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-25b9f796-0408-4f06-8a1d-f1c12fccb838 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.185057 Jun 15 14:44:49.522474 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 119/236] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:49 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:49.778824 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-7956aa1a-d17e-48eb-9446-a3dd7fe4a47a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:49.780820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-7956aa1a-d17e-48eb-9446-a3dd7fe4a47a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:49.787035 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7956aa1a-d17e-48eb-9446-a3dd7fe4a47a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:49.787486 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7956aa1a-d17e-48eb-9446-a3dd7fe4a47a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:49.788238 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7956aa1a-d17e-48eb-9446-a3dd7fe4a47a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:49.788671 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7956aa1a-d17e-48eb-9446-a3dd7fe4a47a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:49.922576 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-7956aa1a-d17e-48eb-9446-a3dd7fe4a47a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:49.930242 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-7956aa1a-d17e-48eb-9446-a3dd7fe4a47a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1359 microversion: 2.1 time: 0.155205 Jun 15 14:44:49.933997 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 118/237] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:49 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:50.540498 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c663d1e7-2b0d-4e4e-a48b-c5e644d0c149 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:50.541117 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c663d1e7-2b0d-4e4e-a48b-c5e644d0c149 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:50.548062 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c663d1e7-2b0d-4e4e-a48b-c5e644d0c149 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:50.548519 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c663d1e7-2b0d-4e4e-a48b-c5e644d0c149 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:50.549302 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c663d1e7-2b0d-4e4e-a48b-c5e644d0c149 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:50.549766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c663d1e7-2b0d-4e4e-a48b-c5e644d0c149 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:50.693944 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c663d1e7-2b0d-4e4e-a48b-c5e644d0c149 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:50.702982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-c663d1e7-2b0d-4e4e-a48b-c5e644d0c149 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.166291 Jun 15 14:44:50.711062 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 120/238] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:50 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:50.947410 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-7bd8a9c7-23df-4522-a06f-9cc0ceab2b2f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:50.948030 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-7bd8a9c7-23df-4522-a06f-9cc0ceab2b2f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:50.954665 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7bd8a9c7-23df-4522-a06f-9cc0ceab2b2f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:50.955161 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7bd8a9c7-23df-4522-a06f-9cc0ceab2b2f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:50.955935 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7bd8a9c7-23df-4522-a06f-9cc0ceab2b2f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:50.956372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7bd8a9c7-23df-4522-a06f-9cc0ceab2b2f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:51.132583 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-7bd8a9c7-23df-4522-a06f-9cc0ceab2b2f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:51.145004 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-7bd8a9c7-23df-4522-a06f-9cc0ceab2b2f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1359 microversion: 2.1 time: 0.201744 Jun 15 14:44:51.155065 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 119/239] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:50 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:51.720706 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-66e27688-14ee-4c0f-8373-65cd817d6ce2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:51.721349 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-66e27688-14ee-4c0f-8373-65cd817d6ce2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:51.729255 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-66e27688-14ee-4c0f-8373-65cd817d6ce2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:51.729736 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-66e27688-14ee-4c0f-8373-65cd817d6ce2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:51.730536 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-66e27688-14ee-4c0f-8373-65cd817d6ce2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:51.730977 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-66e27688-14ee-4c0f-8373-65cd817d6ce2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:51.882880 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-66e27688-14ee-4c0f-8373-65cd817d6ce2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:51.891530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-66e27688-14ee-4c0f-8373-65cd817d6ce2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.174592 Jun 15 14:44:51.892299 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 121/240] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:51 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:52.162260 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-56bc18e7-6d4a-47d6-806e-56b892854123 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:52.162827 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-56bc18e7-6d4a-47d6-806e-56b892854123 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:52.168882 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-56bc18e7-6d4a-47d6-806e-56b892854123 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:52.169351 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-56bc18e7-6d4a-47d6-806e-56b892854123 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:52.170147 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-56bc18e7-6d4a-47d6-806e-56b892854123 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:52.170589 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-56bc18e7-6d4a-47d6-806e-56b892854123 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:52.305582 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-56bc18e7-6d4a-47d6-806e-56b892854123 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:52.312994 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-56bc18e7-6d4a-47d6-806e-56b892854123 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1359 microversion: 2.1 time: 0.154736 Jun 15 14:44:52.313574 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 120/241] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:52 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:52.913682 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-33d229be-02db-4bdd-9af1-2d11881e3af4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:52.913682 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-33d229be-02db-4bdd-9af1-2d11881e3af4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:52.922560 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=2 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:52.923459 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=10 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:52.935497 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-33d229be-02db-4bdd-9af1-2d11881e3af4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:52.936059 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-33d229be-02db-4bdd-9af1-2d11881e3af4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:52.936921 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-33d229be-02db-4bdd-9af1-2d11881e3af4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:52.937463 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-33d229be-02db-4bdd-9af1-2d11881e3af4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:53.107785 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-33d229be-02db-4bdd-9af1-2d11881e3af4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:53.116558 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-33d229be-02db-4bdd-9af1-2d11881e3af4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.212026 Jun 15 14:44:53.117746 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 122/242] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:52 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:53.330655 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-af8c9aaf-77b8-4004-a05a-78fcf8cd9107 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:53.331938 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-af8c9aaf-77b8-4004-a05a-78fcf8cd9107 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:53.335116 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=2 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:53.339387 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-af8c9aaf-77b8-4004-a05a-78fcf8cd9107 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:53.340128 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-af8c9aaf-77b8-4004-a05a-78fcf8cd9107 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:53.341141 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-af8c9aaf-77b8-4004-a05a-78fcf8cd9107 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:53.341724 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-af8c9aaf-77b8-4004-a05a-78fcf8cd9107 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:53.530595 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-af8c9aaf-77b8-4004-a05a-78fcf8cd9107 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:53.539087 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-af8c9aaf-77b8-4004-a05a-78fcf8cd9107 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1359 microversion: 2.1 time: 0.212309 Jun 15 14:44:53.540301 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 121/243] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:53 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:54.141158 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-2de130aa-54b2-41e2-916c-7d0922099843 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:54.145361 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-2de130aa-54b2-41e2-916c-7d0922099843 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:54.156651 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2de130aa-54b2-41e2-916c-7d0922099843 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:54.157536 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2de130aa-54b2-41e2-916c-7d0922099843 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:54.159876 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2de130aa-54b2-41e2-916c-7d0922099843 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:54.160732 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2de130aa-54b2-41e2-916c-7d0922099843 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:54.364330 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-2de130aa-54b2-41e2-916c-7d0922099843 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:54.372710 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-2de130aa-54b2-41e2-916c-7d0922099843 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.242857 Jun 15 14:44:54.384077 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 123/244] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:54 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:54.558047 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-de23884c-dbc3-4248-9e9a-76449d2d7f9f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:54.558674 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-de23884c-dbc3-4248-9e9a-76449d2d7f9f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:54.566119 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-de23884c-dbc3-4248-9e9a-76449d2d7f9f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:54.566843 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-de23884c-dbc3-4248-9e9a-76449d2d7f9f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:54.568046 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-de23884c-dbc3-4248-9e9a-76449d2d7f9f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:54.568742 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-de23884c-dbc3-4248-9e9a-76449d2d7f9f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:54.757332 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-de23884c-dbc3-4248-9e9a-76449d2d7f9f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:54.765230 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-de23884c-dbc3-4248-9e9a-76449d2d7f9f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1359 microversion: 2.1 time: 0.212576 Jun 15 14:44:54.775334 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 122/245] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:54 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:55.392284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-5393a552-8433-48b3-b6c2-5d4d8e628bb6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:55.394576 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-5393a552-8433-48b3-b6c2-5d4d8e628bb6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:55.397303 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:55.403562 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5393a552-8433-48b3-b6c2-5d4d8e628bb6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:55.404277 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5393a552-8433-48b3-b6c2-5d4d8e628bb6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:55.405252 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5393a552-8433-48b3-b6c2-5d4d8e628bb6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:55.405911 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5393a552-8433-48b3-b6c2-5d4d8e628bb6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:55.573999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-5393a552-8433-48b3-b6c2-5d4d8e628bb6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:55.581983 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-5393a552-8433-48b3-b6c2-5d4d8e628bb6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.193793 Jun 15 14:44:55.582587 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 124/246] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:55 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:55.782220 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-4dce767b-24a7-4a67-8b9c-00371b8f0446 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:55.782831 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-4dce767b-24a7-4a67-8b9c-00371b8f0446 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:55.789813 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4dce767b-24a7-4a67-8b9c-00371b8f0446 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:55.790323 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4dce767b-24a7-4a67-8b9c-00371b8f0446 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:55.791091 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4dce767b-24a7-4a67-8b9c-00371b8f0446 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:55.791859 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4dce767b-24a7-4a67-8b9c-00371b8f0446 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:55.972402 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-4dce767b-24a7-4a67-8b9c-00371b8f0446 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:55.985052 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-4dce767b-24a7-4a67-8b9c-00371b8f0446 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1359 microversion: 2.1 time: 0.206404 Jun 15 14:44:55.987790 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 123/247] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:55 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:56.603561 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-107dcaca-83bd-4013-bc2d-e4106680a44f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:56.604199 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-107dcaca-83bd-4013-bc2d-e4106680a44f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:56.611064 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-107dcaca-83bd-4013-bc2d-e4106680a44f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:56.612272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-107dcaca-83bd-4013-bc2d-e4106680a44f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:56.613141 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-107dcaca-83bd-4013-bc2d-e4106680a44f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:56.613541 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-107dcaca-83bd-4013-bc2d-e4106680a44f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:56.825312 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-107dcaca-83bd-4013-bc2d-e4106680a44f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:56.834018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-107dcaca-83bd-4013-bc2d-e4106680a44f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.234294 Jun 15 14:44:56.834877 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 125/248] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:56 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:57.003415 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a4ade78c-bb8e-4bef-ab9b-0a8437d5d6fa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:57.004328 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a4ade78c-bb8e-4bef-ab9b-0a8437d5d6fa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:57.011448 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a4ade78c-bb8e-4bef-ab9b-0a8437d5d6fa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:57.011909 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a4ade78c-bb8e-4bef-ab9b-0a8437d5d6fa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:57.012834 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a4ade78c-bb8e-4bef-ab9b-0a8437d5d6fa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:57.013403 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a4ade78c-bb8e-4bef-ab9b-0a8437d5d6fa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:57.172926 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a4ade78c-bb8e-4bef-ab9b-0a8437d5d6fa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:57.182039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a4ade78c-bb8e-4bef-ab9b-0a8437d5d6fa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1359 microversion: 2.1 time: 0.182579 Jun 15 14:44:57.182603 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 124/249] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:56 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:44:57.854695 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-46d26608-d932-4786-9637-0f6a3a79c21e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:57.855426 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-46d26608-d932-4786-9637-0f6a3a79c21e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:57.870657 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-46d26608-d932-4786-9637-0f6a3a79c21e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:57.871124 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-46d26608-d932-4786-9637-0f6a3a79c21e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:57.872052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-46d26608-d932-4786-9637-0f6a3a79c21e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:57.872497 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-46d26608-d932-4786-9637-0f6a3a79c21e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:58.083172 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-46d26608-d932-4786-9637-0f6a3a79c21e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:58.092917 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-46d26608-d932-4786-9637-0f6a3a79c21e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.241956 Jun 15 14:44:58.094197 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 126/250] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:57 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:58.198410 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-38973f59-3e0a-4b91-b0da-1851bd429a55 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:58.199383 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-38973f59-3e0a-4b91-b0da-1851bd429a55 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:58.206751 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-38973f59-3e0a-4b91-b0da-1851bd429a55 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:58.207592 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-38973f59-3e0a-4b91-b0da-1851bd429a55 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:58.209569 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-38973f59-3e0a-4b91-b0da-1851bd429a55 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:58.210191 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-38973f59-3e0a-4b91-b0da-1851bd429a55 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:58.407373 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-38973f59-3e0a-4b91-b0da-1851bd429a55 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:58.415083 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-38973f59-3e0a-4b91-b0da-1851bd429a55 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1359 microversion: 2.1 time: 0.220476 Jun 15 14:44:58.415656 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 125/251] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:58 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:59.110993 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-20a1994c-44b7-416d-99ef-01c4868a5b9e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:59.112353 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-20a1994c-44b7-416d-99ef-01c4868a5b9e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:59.119121 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-20a1994c-44b7-416d-99ef-01c4868a5b9e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:59.119570 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-20a1994c-44b7-416d-99ef-01c4868a5b9e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:59.120409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-20a1994c-44b7-416d-99ef-01c4868a5b9e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:59.120924 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-20a1994c-44b7-416d-99ef-01c4868a5b9e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:59.261133 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-20a1994c-44b7-416d-99ef-01c4868a5b9e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:59.270144 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-20a1994c-44b7-416d-99ef-01c4868a5b9e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.162884 Jun 15 14:44:59.270892 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 127/252] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:59 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:59.433309 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-3263b3f4-ef21-4309-894e-554a62c535ed tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:59.433945 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-3263b3f4-ef21-4309-894e-554a62c535ed tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:44:59.439830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3263b3f4-ef21-4309-894e-554a62c535ed tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:59.440354 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3263b3f4-ef21-4309-894e-554a62c535ed tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:59.441113 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3263b3f4-ef21-4309-894e-554a62c535ed tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:44:59.441541 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3263b3f4-ef21-4309-894e-554a62c535ed tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:44:59.584260 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-3263b3f4-ef21-4309-894e-554a62c535ed tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:44:59.592936 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-3263b3f4-ef21-4309-894e-554a62c535ed tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1359 microversion: 2.1 time: 0.164180 Jun 15 14:44:59.598276 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 126/253] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:44:59 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:00.288205 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-df98be99-636f-4a7f-adae-b6eb55890a85 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:00.289254 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-df98be99-636f-4a7f-adae-b6eb55890a85 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:00.296712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-df98be99-636f-4a7f-adae-b6eb55890a85 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:00.297243 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-df98be99-636f-4a7f-adae-b6eb55890a85 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:00.298111 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-df98be99-636f-4a7f-adae-b6eb55890a85 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:00.298552 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-df98be99-636f-4a7f-adae-b6eb55890a85 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:00.449867 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-df98be99-636f-4a7f-adae-b6eb55890a85 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:00.458083 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-df98be99-636f-4a7f-adae-b6eb55890a85 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.174564 Jun 15 14:45:00.458659 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 128/254] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:00 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:00.613256 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-044c4548-dee0-4801-9833-60cc6003b1dd tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:00.614116 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-044c4548-dee0-4801-9833-60cc6003b1dd tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:00.620182 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-044c4548-dee0-4801-9833-60cc6003b1dd tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:00.620708 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-044c4548-dee0-4801-9833-60cc6003b1dd tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:00.621630 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-044c4548-dee0-4801-9833-60cc6003b1dd tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:00.622164 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-044c4548-dee0-4801-9833-60cc6003b1dd tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:00.761920 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-044c4548-dee0-4801-9833-60cc6003b1dd tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:00.769932 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-044c4548-dee0-4801-9833-60cc6003b1dd tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1359 microversion: 2.1 time: 0.160604 Jun 15 14:45:00.771058 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 127/255] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:00 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:01.476226 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c578668a-7c01-4ce3-84e5-85b966f82ee2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:01.476896 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c578668a-7c01-4ce3-84e5-85b966f82ee2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:01.489867 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c578668a-7c01-4ce3-84e5-85b966f82ee2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:01.489867 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c578668a-7c01-4ce3-84e5-85b966f82ee2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:01.489867 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c578668a-7c01-4ce3-84e5-85b966f82ee2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:01.489867 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c578668a-7c01-4ce3-84e5-85b966f82ee2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:01.619261 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c578668a-7c01-4ce3-84e5-85b966f82ee2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:01.621534 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=100 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:01.629354 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-c578668a-7c01-4ce3-84e5-85b966f82ee2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.157671 Jun 15 14:45:01.630074 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 129/256] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:01 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:01.787514 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c588f1c2-9406-4e5c-ac2d-5d9a5d42183a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:01.788138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-c588f1c2-9406-4e5c-ac2d-5d9a5d42183a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:01.794514 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c588f1c2-9406-4e5c-ac2d-5d9a5d42183a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:01.794961 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c588f1c2-9406-4e5c-ac2d-5d9a5d42183a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:01.795716 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c588f1c2-9406-4e5c-ac2d-5d9a5d42183a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:01.796152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c588f1c2-9406-4e5c-ac2d-5d9a5d42183a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:01.926994 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-c588f1c2-9406-4e5c-ac2d-5d9a5d42183a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:01.935949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-c588f1c2-9406-4e5c-ac2d-5d9a5d42183a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1359 microversion: 2.1 time: 0.152657 Jun 15 14:45:01.936651 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 128/257] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:01 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:02.651531 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3266995c-c07a-464c-bb10-cf5d140287a7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:02.653409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-3266995c-c07a-464c-bb10-cf5d140287a7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:02.660850 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3266995c-c07a-464c-bb10-cf5d140287a7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:02.661639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3266995c-c07a-464c-bb10-cf5d140287a7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:02.662671 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3266995c-c07a-464c-bb10-cf5d140287a7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:02.663311 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3266995c-c07a-464c-bb10-cf5d140287a7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:02.919155 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-3266995c-c07a-464c-bb10-cf5d140287a7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:02.936140 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-3266995c-c07a-464c-bb10-cf5d140287a7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.289726 Jun 15 14:45:02.943846 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 130/258] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:02 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:02.953370 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-d6ff3031-d159-4a3f-8221-4ff4bffc6178 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:02.954040 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-d6ff3031-d159-4a3f-8221-4ff4bffc6178 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:02.961680 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d6ff3031-d159-4a3f-8221-4ff4bffc6178 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:02.962809 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d6ff3031-d159-4a3f-8221-4ff4bffc6178 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:02.963916 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d6ff3031-d159-4a3f-8221-4ff4bffc6178 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:02.964362 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d6ff3031-d159-4a3f-8221-4ff4bffc6178 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:03.204044 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-d6ff3031-d159-4a3f-8221-4ff4bffc6178 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:03.220272 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-d6ff3031-d159-4a3f-8221-4ff4bffc6178 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1359 microversion: 2.1 time: 0.271369 Jun 15 14:45:03.222268 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 129/259] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:02 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1359 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:03.475088 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-c66e5515-1a8f-49a3-b999-8a5113b7298f req-436479b9-b553-4817-8d24-bda207cda4ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "080870aa-ea48-4010-a1cf-1fbf6c52b03e", "tag": "72e53405-4f12-4857-b499-0ea88b11d04e"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:45:03.488432 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-c66e5515-1a8f-49a3-b999-8a5113b7298f req-436479b9-b553-4817-8d24-bda207cda4ef service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:03.489278 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-c66e5515-1a8f-49a3-b999-8a5113b7298f req-436479b9-b553-4817-8d24-bda207cda4ef service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:03.506291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-c66e5515-1a8f-49a3-b999-8a5113b7298f req-436479b9-b553-4817-8d24-bda207cda4ef service nova] Creating event network-changed:72e53405-4f12-4857-b499-0ea88b11d04e for instance 080870aa-ea48-4010-a1cf-1fbf6c52b03e on hv-cinder-84327 Jun 15 14:45:03.512620 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-c66e5515-1a8f-49a3-b999-8a5113b7298f req-436479b9-b553-4817-8d24-bda207cda4ef service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045463 Jun 15 14:45:03.513287 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 131/260] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:45:03.958441 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-13ca187b-bc9e-40f5-87a8-9edd97bb3733 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:03.959185 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-13ca187b-bc9e-40f5-87a8-9edd97bb3733 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:03.966313 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-13ca187b-bc9e-40f5-87a8-9edd97bb3733 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:03.966840 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-13ca187b-bc9e-40f5-87a8-9edd97bb3733 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:03.967671 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-13ca187b-bc9e-40f5-87a8-9edd97bb3733 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:03.968490 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-13ca187b-bc9e-40f5-87a8-9edd97bb3733 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:04.120269 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-13ca187b-bc9e-40f5-87a8-9edd97bb3733 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:04.128547 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-13ca187b-bc9e-40f5-87a8-9edd97bb3733 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.177111 Jun 15 14:45:04.129114 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 130/261] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:03 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:04.239568 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-91f13b5c-d056-46df-924e-c3edf5414a8b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:04.240363 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-91f13b5c-d056-46df-924e-c3edf5414a8b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:04.248470 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-91f13b5c-d056-46df-924e-c3edf5414a8b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:04.248924 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-91f13b5c-d056-46df-924e-c3edf5414a8b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:04.249731 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-91f13b5c-d056-46df-924e-c3edf5414a8b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:04.250170 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-91f13b5c-d056-46df-924e-c3edf5414a8b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:04.400054 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-91f13b5c-d056-46df-924e-c3edf5414a8b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:04.407510 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-91f13b5c-d056-46df-924e-c3edf5414a8b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1359 microversion: 2.1 time: 0.173312 Jun 15 14:45:04.408072 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 132/262] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:04 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:05.147137 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-47e97d7f-d950-47fc-a9a6-0189d40e213b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:05.147737 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-47e97d7f-d950-47fc-a9a6-0189d40e213b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:05.153614 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-47e97d7f-d950-47fc-a9a6-0189d40e213b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:05.154085 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-47e97d7f-d950-47fc-a9a6-0189d40e213b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:05.154832 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-47e97d7f-d950-47fc-a9a6-0189d40e213b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:05.155262 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-47e97d7f-d950-47fc-a9a6-0189d40e213b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:05.159772 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=100 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:05.286516 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-47e97d7f-d950-47fc-a9a6-0189d40e213b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:05.294469 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-47e97d7f-d950-47fc-a9a6-0189d40e213b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.151583 Jun 15 14:45:05.295063 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 131/263] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:05 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:05.424284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-2b9bb84f-8657-4b63-9317-08aa2ac3f373 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:05.425461 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-2b9bb84f-8657-4b63-9317-08aa2ac3f373 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:05.431933 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2b9bb84f-8657-4b63-9317-08aa2ac3f373 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:05.432382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2b9bb84f-8657-4b63-9317-08aa2ac3f373 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:05.433138 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2b9bb84f-8657-4b63-9317-08aa2ac3f373 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:05.433581 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2b9bb84f-8657-4b63-9317-08aa2ac3f373 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:05.560312 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-2b9bb84f-8657-4b63-9317-08aa2ac3f373 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:05.568293 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-2b9bb84f-8657-4b63-9317-08aa2ac3f373 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1359 microversion: 2.1 time: 0.147915 Jun 15 14:45:05.568856 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 133/264] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:05 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:06.312286 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-698e1d01-ac8f-4de9-b910-49e4f525388d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:06.312893 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-698e1d01-ac8f-4de9-b910-49e4f525388d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:06.319264 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-698e1d01-ac8f-4de9-b910-49e4f525388d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:06.319706 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-698e1d01-ac8f-4de9-b910-49e4f525388d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:06.320467 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-698e1d01-ac8f-4de9-b910-49e4f525388d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:06.320902 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-698e1d01-ac8f-4de9-b910-49e4f525388d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:06.456090 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-698e1d01-ac8f-4de9-b910-49e4f525388d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:06.464038 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-698e1d01-ac8f-4de9-b910-49e4f525388d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.155707 Jun 15 14:45:06.464584 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 132/265] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:06 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:06.585911 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-d6fa23c4-4625-47cc-8cdc-a710ddfb2e6e tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:06.586762 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-d6fa23c4-4625-47cc-8cdc-a710ddfb2e6e tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:06.594156 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d6fa23c4-4625-47cc-8cdc-a710ddfb2e6e tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:06.594610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d6fa23c4-4625-47cc-8cdc-a710ddfb2e6e tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:06.595384 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d6fa23c4-4625-47cc-8cdc-a710ddfb2e6e tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:06.595826 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d6fa23c4-4625-47cc-8cdc-a710ddfb2e6e tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:06.830063 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d6fa23c4-4625-47cc-8cdc-a710ddfb2e6e tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:06.839693 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-d6fa23c4-4625-47cc-8cdc-a710ddfb2e6e tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1359 microversion: 2.1 time: 0.259249 Jun 15 14:45:06.840269 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 134/266] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:06 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1359 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:07.481778 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a5aa0a82-9164-4747-893a-3eb21aca4989 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:07.482503 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a5aa0a82-9164-4747-893a-3eb21aca4989 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:07.488421 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a5aa0a82-9164-4747-893a-3eb21aca4989 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:07.488932 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a5aa0a82-9164-4747-893a-3eb21aca4989 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:07.489702 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a5aa0a82-9164-4747-893a-3eb21aca4989 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:07.490137 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a5aa0a82-9164-4747-893a-3eb21aca4989 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:07.621477 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a5aa0a82-9164-4747-893a-3eb21aca4989 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:07.629779 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a5aa0a82-9164-4747-893a-3eb21aca4989 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.152470 Jun 15 14:45:07.630360 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 133/267] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:07 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:07.857196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3aa2bd7e-fbfb-4206-906c-c88fdd3da945 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:07.857841 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-3aa2bd7e-fbfb-4206-906c-c88fdd3da945 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:07.864462 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3aa2bd7e-fbfb-4206-906c-c88fdd3da945 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:07.864910 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3aa2bd7e-fbfb-4206-906c-c88fdd3da945 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:07.865681 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3aa2bd7e-fbfb-4206-906c-c88fdd3da945 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:07.866126 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3aa2bd7e-fbfb-4206-906c-c88fdd3da945 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:07.996044 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-3aa2bd7e-fbfb-4206-906c-c88fdd3da945 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:08.004395 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-3aa2bd7e-fbfb-4206-906c-c88fdd3da945 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1359 microversion: 2.1 time: 0.150900 Jun 15 14:45:08.005007 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 135/268] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:07 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:08.646691 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-9656af3c-9b89-4d8e-b75b-985007d2319b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:08.647306 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-9656af3c-9b89-4d8e-b75b-985007d2319b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:08.653418 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9656af3c-9b89-4d8e-b75b-985007d2319b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:08.653885 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9656af3c-9b89-4d8e-b75b-985007d2319b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:08.654753 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9656af3c-9b89-4d8e-b75b-985007d2319b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:08.655438 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9656af3c-9b89-4d8e-b75b-985007d2319b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:09.019445 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9656af3c-9b89-4d8e-b75b-985007d2319b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:09.022010 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-70551b1a-2df5-40a1-a303-afe44e194dd2 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:09.022632 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-70551b1a-2df5-40a1-a303-afe44e194dd2 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:09.028378 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-9656af3c-9b89-4d8e-b75b-985007d2319b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.385530 Jun 15 14:45:09.030063 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 134/269] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:08 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:09.030753 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-70551b1a-2df5-40a1-a303-afe44e194dd2 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:09.031522 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-70551b1a-2df5-40a1-a303-afe44e194dd2 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:09.032650 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-70551b1a-2df5-40a1-a303-afe44e194dd2 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:09.033076 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-70551b1a-2df5-40a1-a303-afe44e194dd2 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:09.178604 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-70551b1a-2df5-40a1-a303-afe44e194dd2 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:09.186803 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-70551b1a-2df5-40a1-a303-afe44e194dd2 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1359 microversion: 2.1 time: 0.169519 Jun 15 14:45:09.187376 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 136/270] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:09 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:10.046062 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-2b64e5e5-4610-4b9f-9a47-fd016b3629c6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:10.046684 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-2b64e5e5-4610-4b9f-9a47-fd016b3629c6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:10.053284 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2b64e5e5-4610-4b9f-9a47-fd016b3629c6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:10.053769 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2b64e5e5-4610-4b9f-9a47-fd016b3629c6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:10.054536 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2b64e5e5-4610-4b9f-9a47-fd016b3629c6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:10.054977 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2b64e5e5-4610-4b9f-9a47-fd016b3629c6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:10.180663 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-2b64e5e5-4610-4b9f-9a47-fd016b3629c6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:10.188143 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-2b64e5e5-4610-4b9f-9a47-fd016b3629c6 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.146076 Jun 15 14:45:10.188706 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 135/271] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:10 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:10.204390 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-2a03efa0-e1ec-4d23-a0d0-553a3010c92c tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:10.205004 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-2a03efa0-e1ec-4d23-a0d0-553a3010c92c tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:10.212152 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2a03efa0-e1ec-4d23-a0d0-553a3010c92c tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:10.212602 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2a03efa0-e1ec-4d23-a0d0-553a3010c92c tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:10.213630 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2a03efa0-e1ec-4d23-a0d0-553a3010c92c tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:10.214113 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2a03efa0-e1ec-4d23-a0d0-553a3010c92c tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:10.345469 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-2a03efa0-e1ec-4d23-a0d0-553a3010c92c tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:10.353579 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-2a03efa0-e1ec-4d23-a0d0-553a3010c92c tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1359 microversion: 2.1 time: 0.153243 Jun 15 14:45:10.354191 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 137/272] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:10 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:10.823861 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-b1bca9d5-fd4e-4d07-84f4-63d8ce69ba06 req-51a1f87b-eac3-4892-a4c0-65a643e5549a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "080870aa-ea48-4010-a1cf-1fbf6c52b03e", "name": "network-vif-plugged", "status": "completed", "tag": "72e53405-4f12-4857-b499-0ea88b11d04e"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:45:10.838254 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-b1bca9d5-fd4e-4d07-84f4-63d8ce69ba06 req-51a1f87b-eac3-4892-a4c0-65a643e5549a service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:10.838712 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-b1bca9d5-fd4e-4d07-84f4-63d8ce69ba06 req-51a1f87b-eac3-4892-a4c0-65a643e5549a service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:10.853966 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-b1bca9d5-fd4e-4d07-84f4-63d8ce69ba06 req-51a1f87b-eac3-4892-a4c0-65a643e5549a service nova] Creating event network-vif-plugged:72e53405-4f12-4857-b499-0ea88b11d04e for instance 080870aa-ea48-4010-a1cf-1fbf6c52b03e on hv-cinder-84327 Jun 15 14:45:10.859099 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-b1bca9d5-fd4e-4d07-84f4-63d8ce69ba06 req-51a1f87b-eac3-4892-a4c0-65a643e5549a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040137 Jun 15 14:45:10.860032 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 136/273] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:45:11.205739 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0bc96b70-eab9-4c10-ba1c-ee87f2fc6632 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:11.206359 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-0bc96b70-eab9-4c10-ba1c-ee87f2fc6632 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:11.214054 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0bc96b70-eab9-4c10-ba1c-ee87f2fc6632 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:11.214507 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0bc96b70-eab9-4c10-ba1c-ee87f2fc6632 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:11.215276 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0bc96b70-eab9-4c10-ba1c-ee87f2fc6632 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:11.215711 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0bc96b70-eab9-4c10-ba1c-ee87f2fc6632 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:11.352925 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0bc96b70-eab9-4c10-ba1c-ee87f2fc6632 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:11.360475 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-0bc96b70-eab9-4c10-ba1c-ee87f2fc6632 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.159985 Jun 15 14:45:11.361076 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 138/274] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:11 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:11.371508 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-2f9862ee-2e7f-4546-a59b-2df545467022 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:11.372194 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-2f9862ee-2e7f-4546-a59b-2df545467022 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:11.378373 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2f9862ee-2e7f-4546-a59b-2df545467022 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:11.378812 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2f9862ee-2e7f-4546-a59b-2df545467022 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:11.379559 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2f9862ee-2e7f-4546-a59b-2df545467022 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:11.379990 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2f9862ee-2e7f-4546-a59b-2df545467022 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:11.518846 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-2f9862ee-2e7f-4546-a59b-2df545467022 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:11.527491 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-2f9862ee-2e7f-4546-a59b-2df545467022 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1359 microversion: 2.1 time: 0.160036 Jun 15 14:45:11.528575 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 137/275] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:11 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:12.379322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e592fd03-006f-408b-b07d-5f25cbd834a7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:12.381140 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-e592fd03-006f-408b-b07d-5f25cbd834a7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:12.390370 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e592fd03-006f-408b-b07d-5f25cbd834a7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:12.391218 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e592fd03-006f-408b-b07d-5f25cbd834a7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:12.392155 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e592fd03-006f-408b-b07d-5f25cbd834a7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:12.392745 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e592fd03-006f-408b-b07d-5f25cbd834a7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:12.545997 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-37c51a84-e7c2-4538-a689-0605b12296fa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:12.547617 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-37c51a84-e7c2-4538-a689-0605b12296fa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:12.554737 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-37c51a84-e7c2-4538-a689-0605b12296fa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:12.555449 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-37c51a84-e7c2-4538-a689-0605b12296fa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:12.556307 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-37c51a84-e7c2-4538-a689-0605b12296fa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:12.557146 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-37c51a84-e7c2-4538-a689-0605b12296fa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:12.580756 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e592fd03-006f-408b-b07d-5f25cbd834a7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:12.592273 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-e592fd03-006f-408b-b07d-5f25cbd834a7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.217806 Jun 15 14:45:12.592853 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 139/276] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:12 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:12.727306 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-37c51a84-e7c2-4538-a689-0605b12296fa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:12.740063 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-37c51a84-e7c2-4538-a689-0605b12296fa tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1359 microversion: 2.1 time: 0.199118 Jun 15 14:45:12.751337 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 138/277] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:12 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:13.610981 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-80f5e468-96eb-4ef6-9866-b2df57a48fb7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:13.611592 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-80f5e468-96eb-4ef6-9866-b2df57a48fb7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:13.619293 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-80f5e468-96eb-4ef6-9866-b2df57a48fb7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:13.619738 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-80f5e468-96eb-4ef6-9866-b2df57a48fb7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:13.620537 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-80f5e468-96eb-4ef6-9866-b2df57a48fb7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:13.620968 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-80f5e468-96eb-4ef6-9866-b2df57a48fb7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:13.758867 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-510609ff-230d-46ef-8840-0667cc5b4931 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:13.759685 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-510609ff-230d-46ef-8840-0667cc5b4931 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:13.769727 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-510609ff-230d-46ef-8840-0667cc5b4931 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:13.770531 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-510609ff-230d-46ef-8840-0667cc5b4931 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:13.772626 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-510609ff-230d-46ef-8840-0667cc5b4931 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:13.775539 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-510609ff-230d-46ef-8840-0667cc5b4931 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:13.838304 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-80f5e468-96eb-4ef6-9866-b2df57a48fb7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:13.846865 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-80f5e468-96eb-4ef6-9866-b2df57a48fb7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.239734 Jun 15 14:45:13.847449 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 140/278] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:13 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:13.945031 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-510609ff-230d-46ef-8840-0667cc5b4931 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:13.953914 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-510609ff-230d-46ef-8840-0667cc5b4931 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1549 microversion: 2.1 time: 0.199060 Jun 15 14:45:13.954874 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 139/279] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:13 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1549 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:13.974891 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-b03a3d7f-ceba-46f7-97e5-04b65a0339f2 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:13.975707 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-b03a3d7f-ceba-46f7-97e5-04b65a0339f2 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:13.983524 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b03a3d7f-ceba-46f7-97e5-04b65a0339f2 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:13.984309 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b03a3d7f-ceba-46f7-97e5-04b65a0339f2 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:13.985198 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b03a3d7f-ceba-46f7-97e5-04b65a0339f2 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:13.985772 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b03a3d7f-ceba-46f7-97e5-04b65a0339f2 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:14.153693 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b03a3d7f-ceba-46f7-97e5-04b65a0339f2 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:14.161160 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-b03a3d7f-ceba-46f7-97e5-04b65a0339f2 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1549 microversion: 2.1 time: 0.193286 Jun 15 14:45:14.162330 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 141/280] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:13 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1549 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:14.178198 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1203b50d-5534-40f9-8a41-097a2f96bdb8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:14.181910 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-1203b50d-5534-40f9-8a41-097a2f96bdb8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:14.182685 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1203b50d-5534-40f9-8a41-097a2f96bdb8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Searching by: {'deleted': False, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737'} {{(pid=124220) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 15 14:45:14.184701 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=54 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:14.198088 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1203b50d-5534-40f9-8a41-097a2f96bdb8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:14.198534 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1203b50d-5534-40f9-8a41-097a2f96bdb8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:14.199497 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1203b50d-5534-40f9-8a41-097a2f96bdb8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:14.199928 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1203b50d-5534-40f9-8a41-097a2f96bdb8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:14.296887 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.multi_cell_list [None req-1203b50d-5534-40f9-8a41-097a2f96bdb8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124220) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 15 14:45:14.401171 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-1203b50d-5534-40f9-8a41-097a2f96bdb8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.227166 Jun 15 14:45:14.402067 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 140/281] 10.222.0.57 () {58 vars in 1124 bytes} [Wed Jun 15 14:45:14 2022] GET /compute/v2.1/servers => generated 343 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:45:14.412456 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-7ca5fe4b-7a41-438c-9823-26b32fa4e46f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:14.413131 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-7ca5fe4b-7a41-438c-9823-26b32fa4e46f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:14.419169 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7ca5fe4b-7a41-438c-9823-26b32fa4e46f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:14.419596 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7ca5fe4b-7a41-438c-9823-26b32fa4e46f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:14.420359 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7ca5fe4b-7a41-438c-9823-26b32fa4e46f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:14.420799 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7ca5fe4b-7a41-438c-9823-26b32fa4e46f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:14.558639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-7ca5fe4b-7a41-438c-9823-26b32fa4e46f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:14.567087 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-7ca5fe4b-7a41-438c-9823-26b32fa4e46f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1549 microversion: 2.1 time: 0.158826 Jun 15 14:45:14.567979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 142/282] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:14 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:14.878954 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a2ea9e0a-e601-44f4-8d3d-1624028523d8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:14.879950 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a2ea9e0a-e601-44f4-8d3d-1624028523d8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:14.890085 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a2ea9e0a-e601-44f4-8d3d-1624028523d8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:14.899491 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a2ea9e0a-e601-44f4-8d3d-1624028523d8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:14.899491 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a2ea9e0a-e601-44f4-8d3d-1624028523d8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:14.899491 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a2ea9e0a-e601-44f4-8d3d-1624028523d8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:14.993178 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-94408c73-713f-436b-b41e-21040d01fa1c tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-833881536", "imageRef": "e18802bf-9dac-462c-88ba-5cce79043279", "flavorRef": "452"}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:45:15.053982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.network.neutron [None req-94408c73-713f-436b-b41e-21040d01fa1c tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] validate_networks() for None {{(pid=124219) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:45:15.199340 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a2ea9e0a-e601-44f4-8d3d-1624028523d8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:15.209168 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a2ea9e0a-e601-44f4-8d3d-1624028523d8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.347612 Jun 15 14:45:15.218042 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 141/283] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:14 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:15.357127 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-94408c73-713f-436b-b41e-21040d01fa1c tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Flavor limits 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:45:15.357744 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-94408c73-713f-436b-b41e-21040d01fa1c tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Image limits 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:45:15.358329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-94408c73-713f-436b-b41e-21040d01fa1c tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Flavor pref 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:45:15.358874 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-94408c73-713f-436b-b41e-21040d01fa1c tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Image pref 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:45:15.359753 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-94408c73-713f-436b-b41e-21040d01fa1c tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:45:15.374286 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-94408c73-713f-436b-b41e-21040d01fa1c tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:15.374733 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-94408c73-713f-436b-b41e-21040d01fa1c tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:15.376098 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-94408c73-713f-436b-b41e-21040d01fa1c tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:15.376571 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-94408c73-713f-436b-b41e-21040d01fa1c tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:15.395366 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-94408c73-713f-436b-b41e-21040d01fa1c tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Getting quotas for project a57bab77e60b4efc9df43e95f1ead38b. Resources: {'cores', 'instances', 'ram'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:45:15.400373 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-94408c73-713f-436b-b41e-21040d01fa1c tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Getting quotas for user 7d6eaf2c133743a08314ca0d9dcc59a8 and project a57bab77e60b4efc9df43e95f1ead38b. Resources: {'cores', 'instances', 'ram'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:45:15.412420 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-94408c73-713f-436b-b41e-21040d01fa1c tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Going to run 1 instances... {{(pid=124219) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:45:15.415492 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-94408c73-713f-436b-b41e-21040d01fa1c tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e18802bf-9dac-462c-88ba-5cce79043279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124219) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:45:15.465270 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-94408c73-713f-436b-b41e-21040d01fa1c tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.475601 Jun 15 14:45:15.465957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 143/284] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 14:45:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 14:45:15.476250 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-ef734900-77bd-4ff9-91a9-4f513e452efe tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:15.476899 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-ef734900-77bd-4ff9-91a9-4f513e452efe tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:15.533989 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ef734900-77bd-4ff9-91a9-4f513e452efe tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:15.540897 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-ef734900-77bd-4ff9-91a9-4f513e452efe tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1214 microversion: 2.1 time: 0.068544 Jun 15 14:45:15.541492 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 142/285] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:15 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:16.226605 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-a21e0cbf-4a2e-4867-8017-84530b9fb645 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:16.227217 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-a21e0cbf-4a2e-4867-8017-84530b9fb645 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:16.235953 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a21e0cbf-4a2e-4867-8017-84530b9fb645 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:16.236400 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a21e0cbf-4a2e-4867-8017-84530b9fb645 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:16.237169 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a21e0cbf-4a2e-4867-8017-84530b9fb645 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:16.237610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a21e0cbf-4a2e-4867-8017-84530b9fb645 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:16.366568 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-a21e0cbf-4a2e-4867-8017-84530b9fb645 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:16.373964 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-a21e0cbf-4a2e-4867-8017-84530b9fb645 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.152089 Jun 15 14:45:16.374532 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 144/286] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:16 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:16.558216 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-46276c64-2a0b-42da-adfa-5d66eb9dcef1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:16.558826 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-46276c64-2a0b-42da-adfa-5d66eb9dcef1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:16.564773 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-46276c64-2a0b-42da-adfa-5d66eb9dcef1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:16.565218 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-46276c64-2a0b-42da-adfa-5d66eb9dcef1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:16.566058 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-46276c64-2a0b-42da-adfa-5d66eb9dcef1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:16.566442 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-46276c64-2a0b-42da-adfa-5d66eb9dcef1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:16.627658 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-46276c64-2a0b-42da-adfa-5d66eb9dcef1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:16.635509 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-46276c64-2a0b-42da-adfa-5d66eb9dcef1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1218 microversion: 2.1 time: 0.081177 Jun 15 14:45:16.636055 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 143/287] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:16 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:17.390815 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-4eb5926c-e0ad-4a62-b193-b270b18bf4c7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:17.391424 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-4eb5926c-e0ad-4a62-b193-b270b18bf4c7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:17.399415 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4eb5926c-e0ad-4a62-b193-b270b18bf4c7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:17.399868 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4eb5926c-e0ad-4a62-b193-b270b18bf4c7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:17.400632 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4eb5926c-e0ad-4a62-b193-b270b18bf4c7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:17.401067 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4eb5926c-e0ad-4a62-b193-b270b18bf4c7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:17.532435 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-4eb5926c-e0ad-4a62-b193-b270b18bf4c7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:17.540439 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-4eb5926c-e0ad-4a62-b193-b270b18bf4c7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.153534 Jun 15 14:45:17.541007 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 145/288] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:17 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:17.654195 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-3fa87ec6-eb60-49f2-b911-14929c35ffab tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:17.654801 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-3fa87ec6-eb60-49f2-b911-14929c35ffab tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:17.661263 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3fa87ec6-eb60-49f2-b911-14929c35ffab tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:17.662269 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3fa87ec6-eb60-49f2-b911-14929c35ffab tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:17.663083 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3fa87ec6-eb60-49f2-b911-14929c35ffab tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:17.663520 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3fa87ec6-eb60-49f2-b911-14929c35ffab tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:17.726878 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-3fa87ec6-eb60-49f2-b911-14929c35ffab tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:17.734171 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-3fa87ec6-eb60-49f2-b911-14929c35ffab tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1218 microversion: 2.1 time: 0.085655 Jun 15 14:45:17.734727 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 144/289] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:17 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:18.557261 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-fd0bdfce-03fe-405c-ba8e-e5359d2bf029 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:18.557913 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-fd0bdfce-03fe-405c-ba8e-e5359d2bf029 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:18.564408 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fd0bdfce-03fe-405c-ba8e-e5359d2bf029 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:18.564877 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fd0bdfce-03fe-405c-ba8e-e5359d2bf029 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:18.565628 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fd0bdfce-03fe-405c-ba8e-e5359d2bf029 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:18.566086 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fd0bdfce-03fe-405c-ba8e-e5359d2bf029 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:18.579698 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-f5331d3a-b940-4d58-9b89-bb6fd63856ee tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:18.580274 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-f5331d3a-b940-4d58-9b89-bb6fd63856ee tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:18.587045 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f5331d3a-b940-4d58-9b89-bb6fd63856ee tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:18.587520 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f5331d3a-b940-4d58-9b89-bb6fd63856ee tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:18.588618 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f5331d3a-b940-4d58-9b89-bb6fd63856ee tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:18.589540 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f5331d3a-b940-4d58-9b89-bb6fd63856ee tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:18.615273 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-f5331d3a-b940-4d58-9b89-bb6fd63856ee tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b/ips" status: 200 len: 147 microversion: 2.1 time: 0.039093 Jun 15 14:45:18.616208 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 145/290] 10.222.0.57 () {58 vars in 1247 bytes} [Wed Jun 15 14:45:18 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:45:18.696958 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-fd0bdfce-03fe-405c-ba8e-e5359d2bf029 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:18.704499 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-fd0bdfce-03fe-405c-ba8e-e5359d2bf029 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.151268 Jun 15 14:45:18.705060 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 146/291] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:18 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:18.750784 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-44f23227-3858-4cb1-b3ec-e4e4d918d3e1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:18.751405 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-44f23227-3858-4cb1-b3ec-e4e4d918d3e1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:18.757421 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-44f23227-3858-4cb1-b3ec-e4e4d918d3e1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:18.757924 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-44f23227-3858-4cb1-b3ec-e4e4d918d3e1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:18.758684 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-44f23227-3858-4cb1-b3ec-e4e4d918d3e1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:18.759121 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-44f23227-3858-4cb1-b3ec-e4e4d918d3e1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:18.819004 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-44f23227-3858-4cb1-b3ec-e4e4d918d3e1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:18.826372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-44f23227-3858-4cb1-b3ec-e4e4d918d3e1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1266 microversion: 2.1 time: 0.079436 Jun 15 14:45:18.826934 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 146/292] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:18 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:19.259337 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-bc5dd62d-6366-4601-9130-256b67f7c17c tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d654f3b1-5b06-429e-b059-4ecd0feb8363"}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:45:19.260493 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-bc5dd62d-6366-4601-9130-256b67f7c17c tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:19.267058 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bc5dd62d-6366-4601-9130-256b67f7c17c tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:19.267517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bc5dd62d-6366-4601-9130-256b67f7c17c tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:19.268587 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bc5dd62d-6366-4601-9130-256b67f7c17c tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:19.269034 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bc5dd62d-6366-4601-9130-256b67f7c17c tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:19.343391 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=100 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:19.724841 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-5b4d7569-9f77-4810-b60d-78b2ffbeb332 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:19.725929 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-5b4d7569-9f77-4810-b60d-78b2ffbeb332 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:19.733115 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5b4d7569-9f77-4810-b60d-78b2ffbeb332 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:19.733976 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5b4d7569-9f77-4810-b60d-78b2ffbeb332 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:19.734800 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5b4d7569-9f77-4810-b60d-78b2ffbeb332 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:19.735475 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5b4d7569-9f77-4810-b60d-78b2ffbeb332 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:19.765939 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-bc5dd62d-6366-4601-9130-256b67f7c17c tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "POST /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.511389 Jun 15 14:45:19.766536 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 147/293] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 14:45:19 2022] POST /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e/os-volume_attachments => generated 194 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:45:19.845546 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-cb370e90-a073-4e15-8b25-ac3706a3700e tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:19.846407 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-cb370e90-a073-4e15-8b25-ac3706a3700e tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:19.853810 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-cb370e90-a073-4e15-8b25-ac3706a3700e tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:19.854379 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-cb370e90-a073-4e15-8b25-ac3706a3700e tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:19.855235 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-cb370e90-a073-4e15-8b25-ac3706a3700e tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:19.855779 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-cb370e90-a073-4e15-8b25-ac3706a3700e tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:19.889126 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-5b4d7569-9f77-4810-b60d-78b2ffbeb332 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:19.896724 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-5b4d7569-9f77-4810-b60d-78b2ffbeb332 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.177630 Jun 15 14:45:19.897286 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 147/294] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:19 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:19.921886 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-cb370e90-a073-4e15-8b25-ac3706a3700e tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:19.929873 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-cb370e90-a073-4e15-8b25-ac3706a3700e tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1266 microversion: 2.1 time: 0.088962 Jun 15 14:45:19.930424 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 148/295] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:19 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:20.915658 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-f5a7f603-0edf-40ae-9cd7-143b4e49fa71 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:20.916307 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-f5a7f603-0edf-40ae-9cd7-143b4e49fa71 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:20.923439 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f5a7f603-0edf-40ae-9cd7-143b4e49fa71 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:20.924228 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f5a7f603-0edf-40ae-9cd7-143b4e49fa71 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:20.926682 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f5a7f603-0edf-40ae-9cd7-143b4e49fa71 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:20.927855 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f5a7f603-0edf-40ae-9cd7-143b4e49fa71 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:20.947058 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-d0b71f06-a2f2-453b-8eb0-fa6fe4d1d406 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:20.947675 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-d0b71f06-a2f2-453b-8eb0-fa6fe4d1d406 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:20.954562 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d0b71f06-a2f2-453b-8eb0-fa6fe4d1d406 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:20.955012 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d0b71f06-a2f2-453b-8eb0-fa6fe4d1d406 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:20.956009 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d0b71f06-a2f2-453b-8eb0-fa6fe4d1d406 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:20.956604 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d0b71f06-a2f2-453b-8eb0-fa6fe4d1d406 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:21.031738 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d0b71f06-a2f2-453b-8eb0-fa6fe4d1d406 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:21.046096 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-d0b71f06-a2f2-453b-8eb0-fa6fe4d1d406 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1272 microversion: 2.1 time: 0.099691 Jun 15 14:45:21.046745 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 149/296] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:20 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1272 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:21.089566 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-f5a7f603-0edf-40ae-9cd7-143b4e49fa71 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:21.097462 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-f5a7f603-0edf-40ae-9cd7-143b4e49fa71 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.187551 Jun 15 14:45:21.097993 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 148/297] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:20 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:22.070219 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-9caa9b7b-cc21-46a4-a3f1-883a491c7289 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:22.071142 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-9caa9b7b-cc21-46a4-a3f1-883a491c7289 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:22.078091 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9caa9b7b-cc21-46a4-a3f1-883a491c7289 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:22.078608 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9caa9b7b-cc21-46a4-a3f1-883a491c7289 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:22.079464 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9caa9b7b-cc21-46a4-a3f1-883a491c7289 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:22.079916 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9caa9b7b-cc21-46a4-a3f1-883a491c7289 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:22.115986 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-28dd68fc-9761-472a-a0a2-423da3ea2aa5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:22.116461 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-28dd68fc-9761-472a-a0a2-423da3ea2aa5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:22.126152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-28dd68fc-9761-472a-a0a2-423da3ea2aa5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:22.126785 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-28dd68fc-9761-472a-a0a2-423da3ea2aa5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:22.127554 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-28dd68fc-9761-472a-a0a2-423da3ea2aa5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:22.128172 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-28dd68fc-9761-472a-a0a2-423da3ea2aa5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:22.154028 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=100 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:22.335776 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-9caa9b7b-cc21-46a4-a3f1-883a491c7289 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:22.352576 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-9caa9b7b-cc21-46a4-a3f1-883a491c7289 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1314 microversion: 2.1 time: 0.292677 Jun 15 14:45:22.354802 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-28dd68fc-9761-472a-a0a2-423da3ea2aa5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:22.366092 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 150/298] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:22 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:22.368109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-28dd68fc-9761-472a-a0a2-423da3ea2aa5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1520 microversion: 2.1 time: 0.253491 Jun 15 14:45:22.369218 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 149/299] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:22 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:23.371113 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-72f669a1-fb36-47ed-b4fd-d8e7adaf63ec tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:23.372058 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-72f669a1-fb36-47ed-b4fd-d8e7adaf63ec tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:23.378642 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-72f669a1-fb36-47ed-b4fd-d8e7adaf63ec tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:23.379098 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-72f669a1-fb36-47ed-b4fd-d8e7adaf63ec tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:23.380080 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-72f669a1-fb36-47ed-b4fd-d8e7adaf63ec tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:23.381032 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-72f669a1-fb36-47ed-b4fd-d8e7adaf63ec tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:23.386628 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-0449ce88-d8de-4bb2-8559-d07bcc5287ba tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:23.387956 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-0449ce88-d8de-4bb2-8559-d07bcc5287ba tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:23.398114 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0449ce88-d8de-4bb2-8559-d07bcc5287ba tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:23.398560 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0449ce88-d8de-4bb2-8559-d07bcc5287ba tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:23.399512 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0449ce88-d8de-4bb2-8559-d07bcc5287ba tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:23.405207 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0449ce88-d8de-4bb2-8559-d07bcc5287ba tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:23.564906 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-72f669a1-fb36-47ed-b4fd-d8e7adaf63ec tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:23.575253 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-72f669a1-fb36-47ed-b4fd-d8e7adaf63ec tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1314 microversion: 2.1 time: 0.208046 Jun 15 14:45:23.576783 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 151/300] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:23 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:23.660840 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-0449ce88-d8de-4bb2-8559-d07bcc5287ba tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:23.690336 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-0449ce88-d8de-4bb2-8559-d07bcc5287ba tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1500 microversion: 2.1 time: 0.307013 Jun 15 14:45:23.693772 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 150/301] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:23 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1500 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:23.710055 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-d94ae43f-a24d-4c53-b28e-b08bc09e65f1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:23.710787 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-d94ae43f-a24d-4c53-b28e-b08bc09e65f1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:23.721907 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d94ae43f-a24d-4c53-b28e-b08bc09e65f1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:23.722371 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d94ae43f-a24d-4c53-b28e-b08bc09e65f1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:23.729051 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d94ae43f-a24d-4c53-b28e-b08bc09e65f1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:23.729412 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d94ae43f-a24d-4c53-b28e-b08bc09e65f1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:23.810125 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-fea970ea-28bf-44f4-b23f-5a2fb03088f8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e6efbb0-c846-4ae5-89ff-ab34944f79b3"}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:45:23.811283 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-fea970ea-28bf-44f4-b23f-5a2fb03088f8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:23.832015 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fea970ea-28bf-44f4-b23f-5a2fb03088f8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:23.834249 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fea970ea-28bf-44f4-b23f-5a2fb03088f8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:23.836767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fea970ea-28bf-44f4-b23f-5a2fb03088f8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:23.838459 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fea970ea-28bf-44f4-b23f-5a2fb03088f8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:23.916624 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d94ae43f-a24d-4c53-b28e-b08bc09e65f1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:23.925949 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-d94ae43f-a24d-4c53-b28e-b08bc09e65f1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1514 microversion: 2.1 time: 0.219400 Jun 15 14:45:23.927130 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 152/302] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:23 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1514 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:24.042237 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-b4966cc4-4096-452b-a35d-e9821eefb05b req-8929b648-0796-4373-ad13-dff1bb4d6778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3084f10-2f71-49d3-9b8f-b05204b12bdc", "tag": "9b5a249e-fa51-4473-98b3-2016938ad6ec"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:45:24.057544 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-b4966cc4-4096-452b-a35d-e9821eefb05b req-8929b648-0796-4373-ad13-dff1bb4d6778 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:24.058021 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-b4966cc4-4096-452b-a35d-e9821eefb05b req-8929b648-0796-4373-ad13-dff1bb4d6778 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:24.101737 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-b4966cc4-4096-452b-a35d-e9821eefb05b req-8929b648-0796-4373-ad13-dff1bb4d6778 service nova] Creating event network-changed:9b5a249e-fa51-4473-98b3-2016938ad6ec for instance b3084f10-2f71-49d3-9b8f-b05204b12bdc on hv-cinder-84327 Jun 15 14:45:24.111899 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-b4966cc4-4096-452b-a35d-e9821eefb05b req-8929b648-0796-4373-ad13-dff1bb4d6778 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072811 Jun 15 14:45:24.112875 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 153/303] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:45:24.234385 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=2 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:24.402064 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-fea970ea-28bf-44f4-b23f-5a2fb03088f8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "POST /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.595914 Jun 15 14:45:24.402819 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 151/304] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 14:45:23 2022] POST /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b/os-volume_attachments => generated 194 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:45:24.593114 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-56f58bf7-f646-484b-9065-c11597b2ef3e tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:24.593871 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-56f58bf7-f646-484b-9065-c11597b2ef3e tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:24.600573 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-56f58bf7-f646-484b-9065-c11597b2ef3e tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:24.601018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-56f58bf7-f646-484b-9065-c11597b2ef3e tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:24.601830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-56f58bf7-f646-484b-9065-c11597b2ef3e tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:24.602273 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-56f58bf7-f646-484b-9065-c11597b2ef3e tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:24.736924 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-56f58bf7-f646-484b-9065-c11597b2ef3e tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:24.745454 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-56f58bf7-f646-484b-9065-c11597b2ef3e tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1314 microversion: 2.1 time: 0.156628 Jun 15 14:45:24.746264 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 154/305] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:24 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:25.420717 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-df90b7fe-0582-4617-8b23-1593539e4306 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:45:25.421902 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-df90b7fe-0582-4617-8b23-1593539e4306 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:25.429470 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-df90b7fe-0582-4617-8b23-1593539e4306 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:25.429957 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-df90b7fe-0582-4617-8b23-1593539e4306 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:25.430723 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-df90b7fe-0582-4617-8b23-1593539e4306 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:25.431158 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-df90b7fe-0582-4617-8b23-1593539e4306 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:25.460014 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.objects.instance [None req-df90b7fe-0582-4617-8b23-1593539e4306 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lazy-loading 'flavor' on Instance uuid 24657b06-5ef6-429a-bce1-db0da36fea71 {{(pid=124220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:45:25.548699 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=2 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:25.584092 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-df90b7fe-0582-4617-8b23-1593539e4306 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "POST /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71/action" status: 200 len: 32 microversion: 2.1 time: 0.167660 Jun 15 14:45:25.584865 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 152/306] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 14:45:25 2022] POST /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 15 14:45:25.594051 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-747feae6-e950-4780-a038-129fbba47105 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:25.594666 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-747feae6-e950-4780-a038-129fbba47105 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:25.596618 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=2 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:25.597397 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=6 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:25.598537 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:25.605251 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-747feae6-e950-4780-a038-129fbba47105 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:25.605737 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-747feae6-e950-4780-a038-129fbba47105 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:25.606512 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-747feae6-e950-4780-a038-129fbba47105 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:25.606953 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-747feae6-e950-4780-a038-129fbba47105 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:25.747340 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-747feae6-e950-4780-a038-129fbba47105 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:25.755588 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-747feae6-e950-4780-a038-129fbba47105 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.165200 Jun 15 14:45:25.756196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 155/307] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:25 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:25.764049 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-ff4c1167-9944-4338-b985-83625795f5bc tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:25.764768 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-ff4c1167-9944-4338-b985-83625795f5bc tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:25.772878 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ff4c1167-9944-4338-b985-83625795f5bc tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:25.773335 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ff4c1167-9944-4338-b985-83625795f5bc tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:25.774167 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ff4c1167-9944-4338-b985-83625795f5bc tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:25.774616 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ff4c1167-9944-4338-b985-83625795f5bc tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:25.918502 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ff4c1167-9944-4338-b985-83625795f5bc tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:25.926423 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-ff4c1167-9944-4338-b985-83625795f5bc tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1314 microversion: 2.1 time: 0.167131 Jun 15 14:45:25.927048 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 153/308] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:25 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:26.772447 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-132a3b75-392c-4afb-b53b-789d3146fa45 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:26.772965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-132a3b75-392c-4afb-b53b-789d3146fa45 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:26.779447 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-132a3b75-392c-4afb-b53b-789d3146fa45 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:26.779901 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-132a3b75-392c-4afb-b53b-789d3146fa45 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:26.780660 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-132a3b75-392c-4afb-b53b-789d3146fa45 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:26.781098 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-132a3b75-392c-4afb-b53b-789d3146fa45 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:26.910139 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-132a3b75-392c-4afb-b53b-789d3146fa45 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:26.918059 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-132a3b75-392c-4afb-b53b-789d3146fa45 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.149646 Jun 15 14:45:26.918612 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 156/309] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:26 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:26.943122 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-e4277e4e-fdc1-40c3-9d5d-d91b9332e4fb tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:26.944649 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-e4277e4e-fdc1-40c3-9d5d-d91b9332e4fb tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:26.951086 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e4277e4e-fdc1-40c3-9d5d-d91b9332e4fb tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:26.951533 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e4277e4e-fdc1-40c3-9d5d-d91b9332e4fb tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:26.952288 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e4277e4e-fdc1-40c3-9d5d-d91b9332e4fb tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:26.952724 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e4277e4e-fdc1-40c3-9d5d-d91b9332e4fb tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:27.087651 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e4277e4e-fdc1-40c3-9d5d-d91b9332e4fb tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:27.095249 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-e4277e4e-fdc1-40c3-9d5d-d91b9332e4fb tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1314 microversion: 2.1 time: 0.155977 Jun 15 14:45:27.095802 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 154/310] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:26 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:27.935320 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-27b21f91-e651-49ad-8354-a11a2c7be130 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:27.935928 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-27b21f91-e651-49ad-8354-a11a2c7be130 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:27.942429 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-27b21f91-e651-49ad-8354-a11a2c7be130 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:27.942876 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-27b21f91-e651-49ad-8354-a11a2c7be130 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:27.944144 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-27b21f91-e651-49ad-8354-a11a2c7be130 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:27.944604 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-27b21f91-e651-49ad-8354-a11a2c7be130 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:28.077719 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-27b21f91-e651-49ad-8354-a11a2c7be130 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:28.086157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-27b21f91-e651-49ad-8354-a11a2c7be130 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.154699 Jun 15 14:45:28.086719 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 157/311] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:27 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:28.112011 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-b3c18871-a68e-4851-99d9-075f0e5320b0 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:28.112621 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-b3c18871-a68e-4851-99d9-075f0e5320b0 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:28.119173 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b3c18871-a68e-4851-99d9-075f0e5320b0 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:28.119561 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b3c18871-a68e-4851-99d9-075f0e5320b0 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:28.120316 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b3c18871-a68e-4851-99d9-075f0e5320b0 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:28.120752 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b3c18871-a68e-4851-99d9-075f0e5320b0 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:28.245293 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-b3c18871-a68e-4851-99d9-075f0e5320b0 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:28.252569 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-b3c18871-a68e-4851-99d9-075f0e5320b0 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1314 microversion: 2.1 time: 0.144321 Jun 15 14:45:28.253122 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 155/312] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:28 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:29.104386 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-df2d0921-1557-4ad4-8b4d-5065912512ce tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:29.104988 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-df2d0921-1557-4ad4-8b4d-5065912512ce tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:29.111372 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-df2d0921-1557-4ad4-8b4d-5065912512ce tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:29.111814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-df2d0921-1557-4ad4-8b4d-5065912512ce tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:29.112559 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-df2d0921-1557-4ad4-8b4d-5065912512ce tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:29.112986 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-df2d0921-1557-4ad4-8b4d-5065912512ce tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:29.240884 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-df2d0921-1557-4ad4-8b4d-5065912512ce tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:29.248281 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-df2d0921-1557-4ad4-8b4d-5065912512ce tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.148988 Jun 15 14:45:29.248848 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 158/313] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:29 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:29.269827 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-02139bd8-c21b-4ce2-9296-7c18f84254a7 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:29.270456 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-02139bd8-c21b-4ce2-9296-7c18f84254a7 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:29.277599 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-02139bd8-c21b-4ce2-9296-7c18f84254a7 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:29.278071 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-02139bd8-c21b-4ce2-9296-7c18f84254a7 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:29.278819 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-02139bd8-c21b-4ce2-9296-7c18f84254a7 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:29.279244 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-02139bd8-c21b-4ce2-9296-7c18f84254a7 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:29.408292 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-02139bd8-c21b-4ce2-9296-7c18f84254a7 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:29.417599 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-02139bd8-c21b-4ce2-9296-7c18f84254a7 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1314 microversion: 2.1 time: 0.151508 Jun 15 14:45:29.418225 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 156/314] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:29 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:30.264019 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-a1c6fdcd-0c20-4e49-81d1-1f547fbf8a65 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:30.264693 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-a1c6fdcd-0c20-4e49-81d1-1f547fbf8a65 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:30.271155 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a1c6fdcd-0c20-4e49-81d1-1f547fbf8a65 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:30.272035 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a1c6fdcd-0c20-4e49-81d1-1f547fbf8a65 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:30.272564 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a1c6fdcd-0c20-4e49-81d1-1f547fbf8a65 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:30.273058 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a1c6fdcd-0c20-4e49-81d1-1f547fbf8a65 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:30.408134 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-a1c6fdcd-0c20-4e49-81d1-1f547fbf8a65 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:30.416399 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-a1c6fdcd-0c20-4e49-81d1-1f547fbf8a65 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.156158 Jun 15 14:45:30.417002 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 159/315] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:30 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:30.434769 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1a7d2c4c-7fd4-431b-8fa5-296ad0b7d920 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:30.435386 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1a7d2c4c-7fd4-431b-8fa5-296ad0b7d920 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:30.441750 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1a7d2c4c-7fd4-431b-8fa5-296ad0b7d920 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:30.442224 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1a7d2c4c-7fd4-431b-8fa5-296ad0b7d920 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:30.443033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1a7d2c4c-7fd4-431b-8fa5-296ad0b7d920 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:30.443502 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1a7d2c4c-7fd4-431b-8fa5-296ad0b7d920 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:30.614264 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-1a7d2c4c-7fd4-431b-8fa5-296ad0b7d920 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:30.622587 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-1a7d2c4c-7fd4-431b-8fa5-296ad0b7d920 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1314 microversion: 2.1 time: 0.191639 Jun 15 14:45:30.623162 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 157/316] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:30 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:31.433119 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-5972143c-eb03-4f15-8174-a0c6d22ed290 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:31.433800 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-5972143c-eb03-4f15-8174-a0c6d22ed290 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:31.440659 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5972143c-eb03-4f15-8174-a0c6d22ed290 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:31.441113 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5972143c-eb03-4f15-8174-a0c6d22ed290 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:31.441919 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5972143c-eb03-4f15-8174-a0c6d22ed290 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:31.442359 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5972143c-eb03-4f15-8174-a0c6d22ed290 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:31.571836 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-5972143c-eb03-4f15-8174-a0c6d22ed290 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:31.579387 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-5972143c-eb03-4f15-8174-a0c6d22ed290 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.150077 Jun 15 14:45:31.579955 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 160/317] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:31 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:31.639623 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-d89732a4-6972-4035-9b78-602c1d00c61f tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:31.640235 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-d89732a4-6972-4035-9b78-602c1d00c61f tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:31.647214 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d89732a4-6972-4035-9b78-602c1d00c61f tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:31.647658 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d89732a4-6972-4035-9b78-602c1d00c61f tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:31.648454 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d89732a4-6972-4035-9b78-602c1d00c61f tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:31.648889 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d89732a4-6972-4035-9b78-602c1d00c61f tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:31.782242 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-d89732a4-6972-4035-9b78-602c1d00c61f tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:31.789817 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-d89732a4-6972-4035-9b78-602c1d00c61f tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1314 microversion: 2.1 time: 0.153979 Jun 15 14:45:31.790372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 158/318] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:31 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:32.596028 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-45452270-43b3-490e-a3f2-219699ee0fd4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:32.596642 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-45452270-43b3-490e-a3f2-219699ee0fd4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:32.603738 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-45452270-43b3-490e-a3f2-219699ee0fd4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:32.604184 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-45452270-43b3-490e-a3f2-219699ee0fd4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:32.604941 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-45452270-43b3-490e-a3f2-219699ee0fd4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:32.605374 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-45452270-43b3-490e-a3f2-219699ee0fd4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:32.738385 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-45452270-43b3-490e-a3f2-219699ee0fd4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:32.745982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-45452270-43b3-490e-a3f2-219699ee0fd4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.153717 Jun 15 14:45:32.746535 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 161/319] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:32 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:32.806328 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-7d709496-e609-430e-bfce-129333b3e5b6 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:32.806957 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-7d709496-e609-430e-bfce-129333b3e5b6 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:32.813319 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7d709496-e609-430e-bfce-129333b3e5b6 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:32.813821 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7d709496-e609-430e-bfce-129333b3e5b6 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:32.814573 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7d709496-e609-430e-bfce-129333b3e5b6 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:32.815005 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7d709496-e609-430e-bfce-129333b3e5b6 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:32.943665 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-7d709496-e609-430e-bfce-129333b3e5b6 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:32.951653 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-7d709496-e609-430e-bfce-129333b3e5b6 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1314 microversion: 2.1 time: 0.149271 Jun 15 14:45:32.952214 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 159/320] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:32 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:33.637922 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-9467d20f-3df9-457f-a46c-957ff2d7e5e0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:33.638416 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-9467d20f-3df9-457f-a46c-957ff2d7e5e0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:33.644984 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9467d20f-3df9-457f-a46c-957ff2d7e5e0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:33.645436 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9467d20f-3df9-457f-a46c-957ff2d7e5e0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:33.646767 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9467d20f-3df9-457f-a46c-957ff2d7e5e0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:33.647413 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9467d20f-3df9-457f-a46c-957ff2d7e5e0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:33.670245 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-9467d20f-3df9-457f-a46c-957ff2d7e5e0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0/ips" status: 200 len: 152 microversion: 2.20 time: 0.036172 Jun 15 14:45:33.670803 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 162/321] 10.222.0.57 () {60 vars in 1288 bytes} [Wed Jun 15 14:45:33 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:45:33.762478 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1df64205-9384-42a0-844a-fbb33b861686 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:33.763088 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1df64205-9384-42a0-844a-fbb33b861686 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:33.768893 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1df64205-9384-42a0-844a-fbb33b861686 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:33.769342 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1df64205-9384-42a0-844a-fbb33b861686 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:33.770135 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1df64205-9384-42a0-844a-fbb33b861686 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:33.770570 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1df64205-9384-42a0-844a-fbb33b861686 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:33.904722 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-1df64205-9384-42a0-844a-fbb33b861686 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:33.924016 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-1df64205-9384-42a0-844a-fbb33b861686 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.165135 Jun 15 14:45:33.935165 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 160/322] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:33 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:33.968382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e5cf8a4c-cf4f-41a7-8426-af0f2f340ab7 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:33.969002 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-e5cf8a4c-cf4f-41a7-8426-af0f2f340ab7 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:33.975751 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e5cf8a4c-cf4f-41a7-8426-af0f2f340ab7 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:33.976204 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e5cf8a4c-cf4f-41a7-8426-af0f2f340ab7 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:33.976977 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e5cf8a4c-cf4f-41a7-8426-af0f2f340ab7 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:33.977413 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e5cf8a4c-cf4f-41a7-8426-af0f2f340ab7 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:34.107424 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e5cf8a4c-cf4f-41a7-8426-af0f2f340ab7 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:34.114755 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-e5cf8a4c-cf4f-41a7-8426-af0f2f340ab7 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1314 microversion: 2.1 time: 0.150181 Jun 15 14:45:34.115942 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 163/323] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:33 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:34.944304 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-0635f760-a9fe-411f-98b0-a1d3726d3f5a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:34.944860 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-0635f760-a9fe-411f-98b0-a1d3726d3f5a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:34.951621 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0635f760-a9fe-411f-98b0-a1d3726d3f5a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:34.952076 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0635f760-a9fe-411f-98b0-a1d3726d3f5a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:34.952839 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0635f760-a9fe-411f-98b0-a1d3726d3f5a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:34.953275 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0635f760-a9fe-411f-98b0-a1d3726d3f5a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:35.133191 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-9d845c9b-4d12-43cb-893f-f042bf9bb4e6 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:35.133928 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-9d845c9b-4d12-43cb-893f-f042bf9bb4e6 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:35.144034 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9d845c9b-4d12-43cb-893f-f042bf9bb4e6 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:35.144486 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9d845c9b-4d12-43cb-893f-f042bf9bb4e6 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:35.145276 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9d845c9b-4d12-43cb-893f-f042bf9bb4e6 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:35.145736 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9d845c9b-4d12-43cb-893f-f042bf9bb4e6 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:35.147305 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-0635f760-a9fe-411f-98b0-a1d3726d3f5a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:35.159815 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-0635f760-a9fe-411f-98b0-a1d3726d3f5a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.219259 Jun 15 14:45:35.172559 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 161/324] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:34 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:35.184846 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:35.403575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-9d845c9b-4d12-43cb-893f-f042bf9bb4e6 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:35.418802 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-9d845c9b-4d12-43cb-893f-f042bf9bb4e6 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1314 microversion: 2.1 time: 0.290264 Jun 15 14:45:35.420240 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 164/325] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:35 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:35.866762 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-8a5ef110-191e-4ede-9c57-47ad3dc33bdb tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:35.867425 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-8a5ef110-191e-4ede-9c57-47ad3dc33bdb tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:35.874267 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8a5ef110-191e-4ede-9c57-47ad3dc33bdb tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:35.874718 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8a5ef110-191e-4ede-9c57-47ad3dc33bdb tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:35.875515 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8a5ef110-191e-4ede-9c57-47ad3dc33bdb tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:35.875958 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8a5ef110-191e-4ede-9c57-47ad3dc33bdb tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:36.007111 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-8a5ef110-191e-4ede-9c57-47ad3dc33bdb tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:36.010698 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:36.016471 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-8a5ef110-191e-4ede-9c57-47ad3dc33bdb tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1595 microversion: 2.1 time: 0.154057 Jun 15 14:45:36.017033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 162/326] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:35 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1595 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:36.180314 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-23218825-e641-4532-8c71-67b97226356d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:36.181030 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-23218825-e641-4532-8c71-67b97226356d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:36.187891 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-23218825-e641-4532-8c71-67b97226356d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:36.188535 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-23218825-e641-4532-8c71-67b97226356d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:36.189374 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-23218825-e641-4532-8c71-67b97226356d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:36.189915 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-23218825-e641-4532-8c71-67b97226356d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:36.395056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-23218825-e641-4532-8c71-67b97226356d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:36.403080 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-23218825-e641-4532-8c71-67b97226356d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.227481 Jun 15 14:45:36.403655 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 165/327] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:36 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:36.437625 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-30bbc17f-c485-4ffd-a375-0c8ff962718a tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:36.438419 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-30bbc17f-c485-4ffd-a375-0c8ff962718a tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:36.446999 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-30bbc17f-c485-4ffd-a375-0c8ff962718a tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:36.447496 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-30bbc17f-c485-4ffd-a375-0c8ff962718a tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:36.448524 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-30bbc17f-c485-4ffd-a375-0c8ff962718a tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:36.449072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-30bbc17f-c485-4ffd-a375-0c8ff962718a tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:36.600029 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-30bbc17f-c485-4ffd-a375-0c8ff962718a tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:36.608260 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-30bbc17f-c485-4ffd-a375-0c8ff962718a tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1314 microversion: 2.1 time: 0.175403 Jun 15 14:45:36.608825 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 163/328] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:36 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:37.407032 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-43cc3bbd-a98d-4d7b-a612-8ea878a94b47 req-1c1f86ce-d772-4a28-b85b-2c3229528a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3084f10-2f71-49d3-9b8f-b05204b12bdc", "name": "network-vif-plugged", "status": "completed", "tag": "9b5a249e-fa51-4473-98b3-2016938ad6ec"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:45:37.422921 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-af526b4f-8330-497e-af4b-748c6579ddd2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:37.423700 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-af526b4f-8330-497e-af4b-748c6579ddd2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:37.426189 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-43cc3bbd-a98d-4d7b-a612-8ea878a94b47 req-1c1f86ce-d772-4a28-b85b-2c3229528a5a service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:37.427211 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-43cc3bbd-a98d-4d7b-a612-8ea878a94b47 req-1c1f86ce-d772-4a28-b85b-2c3229528a5a service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:37.432937 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-af526b4f-8330-497e-af4b-748c6579ddd2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:37.433397 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-af526b4f-8330-497e-af4b-748c6579ddd2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:37.434275 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-af526b4f-8330-497e-af4b-748c6579ddd2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:37.435281 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-af526b4f-8330-497e-af4b-748c6579ddd2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:37.452583 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-43cc3bbd-a98d-4d7b-a612-8ea878a94b47 req-1c1f86ce-d772-4a28-b85b-2c3229528a5a service nova] Creating event network-vif-plugged:9b5a249e-fa51-4473-98b3-2016938ad6ec for instance b3084f10-2f71-49d3-9b8f-b05204b12bdc on hv-cinder-84327 Jun 15 14:45:37.463505 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-43cc3bbd-a98d-4d7b-a612-8ea878a94b47 req-1c1f86ce-d772-4a28-b85b-2c3229528a5a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061527 Jun 15 14:45:37.464363 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 166/329] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:45:37.626768 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-b1dc2185-aa26-4ad3-9f31-e9a5249c2793 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:37.628043 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-b1dc2185-aa26-4ad3-9f31-e9a5249c2793 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:37.641082 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b1dc2185-aa26-4ad3-9f31-e9a5249c2793 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:37.641744 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b1dc2185-aa26-4ad3-9f31-e9a5249c2793 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:37.642737 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b1dc2185-aa26-4ad3-9f31-e9a5249c2793 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:37.643166 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b1dc2185-aa26-4ad3-9f31-e9a5249c2793 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:37.810726 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-af526b4f-8330-497e-af4b-748c6579ddd2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:37.818577 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-af526b4f-8330-497e-af4b-748c6579ddd2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.400503 Jun 15 14:45:37.819591 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 164/330] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:37 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:38.025606 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b1dc2185-aa26-4ad3-9f31-e9a5249c2793 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:38.033305 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-b1dc2185-aa26-4ad3-9f31-e9a5249c2793 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1314 microversion: 2.1 time: 0.410902 Jun 15 14:45:38.033927 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 167/331] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:37 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:38.491110 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-e7ff1905-3818-4553-8d7d-d56fb07110f2 req-a98d21c2-de9e-474f-b3fd-d2d14b1232f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "080870aa-ea48-4010-a1cf-1fbf6c52b03e", "tag": "72e53405-4f12-4857-b499-0ea88b11d04e"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:45:38.500538 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-e7ff1905-3818-4553-8d7d-d56fb07110f2 req-a98d21c2-de9e-474f-b3fd-d2d14b1232f1 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:38.501290 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-e7ff1905-3818-4553-8d7d-d56fb07110f2 req-a98d21c2-de9e-474f-b3fd-d2d14b1232f1 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:38.513413 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-e7ff1905-3818-4553-8d7d-d56fb07110f2 req-a98d21c2-de9e-474f-b3fd-d2d14b1232f1 service nova] Creating event network-changed:72e53405-4f12-4857-b499-0ea88b11d04e for instance 080870aa-ea48-4010-a1cf-1fbf6c52b03e on hv-cinder-84327 Jun 15 14:45:38.518862 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-e7ff1905-3818-4553-8d7d-d56fb07110f2 req-a98d21c2-de9e-474f-b3fd-d2d14b1232f1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032399 Jun 15 14:45:38.519559 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 165/332] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:45:38.837330 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-ad0f6e51-5eba-43ee-b360-7b9cb3ea905e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:38.838120 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-ad0f6e51-5eba-43ee-b360-7b9cb3ea905e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:38.845424 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ad0f6e51-5eba-43ee-b360-7b9cb3ea905e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:38.845424 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ad0f6e51-5eba-43ee-b360-7b9cb3ea905e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:38.846209 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ad0f6e51-5eba-43ee-b360-7b9cb3ea905e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:38.846637 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ad0f6e51-5eba-43ee-b360-7b9cb3ea905e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:38.994126 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-ad0f6e51-5eba-43ee-b360-7b9cb3ea905e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:39.002222 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-ad0f6e51-5eba-43ee-b360-7b9cb3ea905e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.169798 Jun 15 14:45:39.003036 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 168/333] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:38 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:39.051378 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-33ffee5d-4da6-4117-ae9e-51b2687540e1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:39.052146 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-33ffee5d-4da6-4117-ae9e-51b2687540e1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:39.059279 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-33ffee5d-4da6-4117-ae9e-51b2687540e1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:39.059809 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-33ffee5d-4da6-4117-ae9e-51b2687540e1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:39.060780 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-33ffee5d-4da6-4117-ae9e-51b2687540e1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:39.061365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-33ffee5d-4da6-4117-ae9e-51b2687540e1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:39.248759 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-33ffee5d-4da6-4117-ae9e-51b2687540e1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:39.260766 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-33ffee5d-4da6-4117-ae9e-51b2687540e1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1314 microversion: 2.1 time: 0.213722 Jun 15 14:45:39.261354 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 166/334] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:39 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:39.747393 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f60f5544-a22f-47eb-9214-362836d9d6d4 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1546716075"}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:45:39.747937 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f60f5544-a22f-47eb-9214-362836d9d6d4 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:39.754127 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f60f5544-a22f-47eb-9214-362836d9d6d4 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:39.754584 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f60f5544-a22f-47eb-9214-362836d9d6d4 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:39.755352 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f60f5544-a22f-47eb-9214-362836d9d6d4 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:39.756571 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f60f5544-a22f-47eb-9214-362836d9d6d4 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:39.939462 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.network.security_group_api [None req-f60f5544-a22f-47eb-9214-362836d9d6d4 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Adding security group eebe3e00-eb11-4fab-a1df-5aeadc19f6e9 to port 72e53405-4f12-4857-b499-0ea88b11d04e Jun 15 14:45:40.020452 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-22699904-51eb-46c5-9ae5-8f71fe64250b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:40.020972 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-22699904-51eb-46c5-9ae5-8f71fe64250b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:40.027430 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-22699904-51eb-46c5-9ae5-8f71fe64250b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:40.027877 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-22699904-51eb-46c5-9ae5-8f71fe64250b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:40.028642 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-22699904-51eb-46c5-9ae5-8f71fe64250b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:40.029075 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-22699904-51eb-46c5-9ae5-8f71fe64250b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:40.161372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-22699904-51eb-46c5-9ae5-8f71fe64250b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:40.169416 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-22699904-51eb-46c5-9ae5-8f71fe64250b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.152944 Jun 15 14:45:40.170005 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 167/335] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:40 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:40.278749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-9a8bbbaa-649b-4fa8-97cb-8903d17bded1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:40.280214 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-9a8bbbaa-649b-4fa8-97cb-8903d17bded1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:40.289265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9a8bbbaa-649b-4fa8-97cb-8903d17bded1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:40.290207 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9a8bbbaa-649b-4fa8-97cb-8903d17bded1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:40.294678 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9a8bbbaa-649b-4fa8-97cb-8903d17bded1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:40.295110 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9a8bbbaa-649b-4fa8-97cb-8903d17bded1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:40.298129 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f60f5544-a22f-47eb-9214-362836d9d6d4 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "POST /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e/action" status: 202 len: 0 microversion: 2.1 time: 0.554877 Jun 15 14:45:40.299488 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 169/336] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 14:45:39 2022] POST /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e/action => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:45:40.308198 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-1246de8a-82df-45cc-b9d1-37964ab1685e tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:40.308982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-1246de8a-82df-45cc-b9d1-37964ab1685e tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:40.318554 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1246de8a-82df-45cc-b9d1-37964ab1685e tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:40.319281 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1246de8a-82df-45cc-b9d1-37964ab1685e tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:40.320242 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1246de8a-82df-45cc-b9d1-37964ab1685e tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:40.320827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1246de8a-82df-45cc-b9d1-37964ab1685e tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:40.464655 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9a8bbbaa-649b-4fa8-97cb-8903d17bded1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:40.472350 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-9a8bbbaa-649b-4fa8-97cb-8903d17bded1 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1314 microversion: 2.1 time: 0.197773 Jun 15 14:45:40.473443 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 168/337] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:40 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:40.504087 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-1246de8a-82df-45cc-b9d1-37964ab1685e tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:40.512304 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-1246de8a-82df-45cc-b9d1-37964ab1685e tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1642 microversion: 2.1 time: 0.209268 Jun 15 14:45:40.512853 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 170/338] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:40 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1642 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:40.533607 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-abdf4b76-cef3-4df8-a9dd-c9b4b25776cf req-fa710c71-8c10-4c48-a08f-395d8e6abddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "080870aa-ea48-4010-a1cf-1fbf6c52b03e", "tag": "72e53405-4f12-4857-b499-0ea88b11d04e"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:45:40.542374 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-abdf4b76-cef3-4df8-a9dd-c9b4b25776cf req-fa710c71-8c10-4c48-a08f-395d8e6abddb service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:40.542819 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-abdf4b76-cef3-4df8-a9dd-c9b4b25776cf req-fa710c71-8c10-4c48-a08f-395d8e6abddb service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:40.553907 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-abdf4b76-cef3-4df8-a9dd-c9b4b25776cf req-fa710c71-8c10-4c48-a08f-395d8e6abddb service nova] Creating event network-changed:72e53405-4f12-4857-b499-0ea88b11d04e for instance 080870aa-ea48-4010-a1cf-1fbf6c52b03e on hv-cinder-84327 Jun 15 14:45:40.558644 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-abdf4b76-cef3-4df8-a9dd-c9b4b25776cf req-fa710c71-8c10-4c48-a08f-395d8e6abddb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028799 Jun 15 14:45:40.559222 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 169/339] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:45:40.835493 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-62b87b61-7a43-4894-a481-1beba41ee252 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:45:40.835955 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-62b87b61-7a43-4894-a481-1beba41ee252 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:40.842375 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-62b87b61-7a43-4894-a481-1beba41ee252 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:40.842830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-62b87b61-7a43-4894-a481-1beba41ee252 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:40.843593 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-62b87b61-7a43-4894-a481-1beba41ee252 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:40.844033 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-62b87b61-7a43-4894-a481-1beba41ee252 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:40.867533 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.objects.instance [None req-62b87b61-7a43-4894-a481-1beba41ee252 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lazy-loading 'flavor' on Instance uuid 123ea48b-cb21-429c-85c6-0ae71d51c1c0 {{(pid=124219) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:45:41.149717 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-62b87b61-7a43-4894-a481-1beba41ee252 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "POST /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0/action" status: 202 len: 0 microversion: 2.20 time: 0.318129 Jun 15 14:45:41.150352 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 171/340] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Jun 15 14:45:40 2022] POST /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:45:41.159486 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-bb373ded-52e6-43e8-8c9f-bc83f59e7d7d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:41.160179 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-bb373ded-52e6-43e8-8c9f-bc83f59e7d7d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:41.166943 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-bb373ded-52e6-43e8-8c9f-bc83f59e7d7d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:41.167397 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-bb373ded-52e6-43e8-8c9f-bc83f59e7d7d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:41.168154 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-bb373ded-52e6-43e8-8c9f-bc83f59e7d7d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:41.168592 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-bb373ded-52e6-43e8-8c9f-bc83f59e7d7d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:41.187259 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-615e9d38-570a-4bb4-b3cf-539fefab9e7e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:41.188111 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-615e9d38-570a-4bb4-b3cf-539fefab9e7e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:41.194746 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-615e9d38-570a-4bb4-b3cf-539fefab9e7e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:41.195197 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-615e9d38-570a-4bb4-b3cf-539fefab9e7e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:41.195965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-615e9d38-570a-4bb4-b3cf-539fefab9e7e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:41.196448 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-615e9d38-570a-4bb4-b3cf-539fefab9e7e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:41.297483 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-bb373ded-52e6-43e8-8c9f-bc83f59e7d7d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:41.306338 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-bb373ded-52e6-43e8-8c9f-bc83f59e7d7d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:41.307842 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-bb373ded-52e6-43e8-8c9f-bc83f59e7d7d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:41.309004 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-bb373ded-52e6-43e8-8c9f-bc83f59e7d7d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.154203 Jun 15 14:45:41.309559 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 170/341] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:45:41 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:45:41.332003 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-615e9d38-570a-4bb4-b3cf-539fefab9e7e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:41.339858 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-615e9d38-570a-4bb4-b3cf-539fefab9e7e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.156712 Jun 15 14:45:41.340407 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 172/342] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:41 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:41.489535 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-0cf5ccab-7161-47ee-9989-c6c3df2173ee tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:41.491250 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-0cf5ccab-7161-47ee-9989-c6c3df2173ee tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:41.497176 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0cf5ccab-7161-47ee-9989-c6c3df2173ee tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:41.497617 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0cf5ccab-7161-47ee-9989-c6c3df2173ee tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:41.498393 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0cf5ccab-7161-47ee-9989-c6c3df2173ee tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:41.498822 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0cf5ccab-7161-47ee-9989-c6c3df2173ee tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:41.634464 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-0cf5ccab-7161-47ee-9989-c6c3df2173ee tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:41.641967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-0cf5ccab-7161-47ee-9989-c6c3df2173ee tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1314 microversion: 2.1 time: 0.156114 Jun 15 14:45:41.642517 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 171/343] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:41 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:42.328042 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0665749a-4a55-40fd-aa5a-33f6f2554283 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:42.328557 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-0665749a-4a55-40fd-aa5a-33f6f2554283 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:42.335712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0665749a-4a55-40fd-aa5a-33f6f2554283 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:42.336160 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0665749a-4a55-40fd-aa5a-33f6f2554283 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:42.336923 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0665749a-4a55-40fd-aa5a-33f6f2554283 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:42.337364 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0665749a-4a55-40fd-aa5a-33f6f2554283 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:42.356268 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-be007dfa-1fe0-49a8-ab5e-df6f4eef898e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:42.356865 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-be007dfa-1fe0-49a8-ab5e-df6f4eef898e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:42.363639 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-be007dfa-1fe0-49a8-ab5e-df6f4eef898e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:42.364318 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-be007dfa-1fe0-49a8-ab5e-df6f4eef898e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:42.365124 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-be007dfa-1fe0-49a8-ab5e-df6f4eef898e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:42.365557 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-be007dfa-1fe0-49a8-ab5e-df6f4eef898e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:42.474102 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0665749a-4a55-40fd-aa5a-33f6f2554283 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:42.484410 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0665749a-4a55-40fd-aa5a-33f6f2554283 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:42.486453 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0665749a-4a55-40fd-aa5a-33f6f2554283 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:42.488141 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-0665749a-4a55-40fd-aa5a-33f6f2554283 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.163404 Jun 15 14:45:42.488695 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 173/344] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:45:42 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:45:42.509203 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-be007dfa-1fe0-49a8-ab5e-df6f4eef898e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:42.516742 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-be007dfa-1fe0-49a8-ab5e-df6f4eef898e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.164275 Jun 15 14:45:42.517296 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 172/345] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:42 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:42.659116 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-38b515a3-08ae-4915-af61-f2b5bdc71bea tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:42.659650 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-38b515a3-08ae-4915-af61-f2b5bdc71bea tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:42.666342 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-38b515a3-08ae-4915-af61-f2b5bdc71bea tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:42.666789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-38b515a3-08ae-4915-af61-f2b5bdc71bea tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:42.667554 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-38b515a3-08ae-4915-af61-f2b5bdc71bea tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:42.667990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-38b515a3-08ae-4915-af61-f2b5bdc71bea tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:42.795110 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-38b515a3-08ae-4915-af61-f2b5bdc71bea tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:42.803058 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-38b515a3-08ae-4915-af61-f2b5bdc71bea tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1314 microversion: 2.1 time: 0.147346 Jun 15 14:45:42.803701 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 174/346] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:42 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:43.508051 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-2ea85b8f-b69b-47f9-a7c6-77ed0b31e16a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:43.510614 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-2ea85b8f-b69b-47f9-a7c6-77ed0b31e16a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:43.516767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2ea85b8f-b69b-47f9-a7c6-77ed0b31e16a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:43.517712 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2ea85b8f-b69b-47f9-a7c6-77ed0b31e16a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:43.518504 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2ea85b8f-b69b-47f9-a7c6-77ed0b31e16a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:43.519066 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2ea85b8f-b69b-47f9-a7c6-77ed0b31e16a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:43.535324 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-084d39ab-21ee-4277-840e-98b243e74a3b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:43.537961 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-084d39ab-21ee-4277-840e-98b243e74a3b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:43.557224 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-084d39ab-21ee-4277-840e-98b243e74a3b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:43.557974 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-084d39ab-21ee-4277-840e-98b243e74a3b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:43.558994 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-084d39ab-21ee-4277-840e-98b243e74a3b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:43.559443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-084d39ab-21ee-4277-840e-98b243e74a3b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:43.699661 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-2ea85b8f-b69b-47f9-a7c6-77ed0b31e16a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:43.710751 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-2ea85b8f-b69b-47f9-a7c6-77ed0b31e16a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:43.713510 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-2ea85b8f-b69b-47f9-a7c6-77ed0b31e16a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:43.714705 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-2ea85b8f-b69b-47f9-a7c6-77ed0b31e16a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.210981 Jun 15 14:45:43.716678 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 173/347] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:45:43 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:45:43.784626 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-084d39ab-21ee-4277-840e-98b243e74a3b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:43.794381 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-084d39ab-21ee-4277-840e-98b243e74a3b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.263562 Jun 15 14:45:43.794957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 175/348] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:43 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:43.819232 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-50028893-f7c3-4b1a-b37c-4bbc9fc2fae5 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:43.819939 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-50028893-f7c3-4b1a-b37c-4bbc9fc2fae5 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:43.826108 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-50028893-f7c3-4b1a-b37c-4bbc9fc2fae5 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:43.826648 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-50028893-f7c3-4b1a-b37c-4bbc9fc2fae5 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:43.827434 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-50028893-f7c3-4b1a-b37c-4bbc9fc2fae5 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:43.827854 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-50028893-f7c3-4b1a-b37c-4bbc9fc2fae5 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:43.971854 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-50028893-f7c3-4b1a-b37c-4bbc9fc2fae5 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:43.980190 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-50028893-f7c3-4b1a-b37c-4bbc9fc2fae5 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1464 microversion: 2.1 time: 0.165036 Jun 15 14:45:43.980877 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 174/349] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:43 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1464 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:44.020592 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-1319806a-6f2d-4003-982d-c5aef9023c10 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:44.021795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-1319806a-6f2d-4003-982d-c5aef9023c10 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:44.028302 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1319806a-6f2d-4003-982d-c5aef9023c10 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:44.028748 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1319806a-6f2d-4003-982d-c5aef9023c10 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:44.029499 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1319806a-6f2d-4003-982d-c5aef9023c10 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:44.029954 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1319806a-6f2d-4003-982d-c5aef9023c10 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:44.055961 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-1319806a-6f2d-4003-982d-c5aef9023c10 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Going to try to terminate instance {{(pid=124219) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:45:44.131536 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-1319806a-6f2d-4003-982d-c5aef9023c10 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 204 len: 0 microversion: 2.1 time: 0.114031 Jun 15 14:45:44.132102 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 176/350] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:45:44 2022] DELETE /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 14:45:44.140160 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-9822ec71-a207-417a-b823-0c3f486cd2af tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:44.140974 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-9822ec71-a207-417a-b823-0c3f486cd2af tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:44.148006 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9822ec71-a207-417a-b823-0c3f486cd2af tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:44.148445 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9822ec71-a207-417a-b823-0c3f486cd2af tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:44.149203 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9822ec71-a207-417a-b823-0c3f486cd2af tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:44.149629 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9822ec71-a207-417a-b823-0c3f486cd2af tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:44.275753 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9822ec71-a207-417a-b823-0c3f486cd2af tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:44.283205 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-9822ec71-a207-417a-b823-0c3f486cd2af tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1470 microversion: 2.1 time: 0.146805 Jun 15 14:45:44.283752 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 175/351] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:44 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1470 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:44.738806 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-40fb5891-f93d-45f4-aaf8-a5320afe0a3c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:44.739435 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-40fb5891-f93d-45f4-aaf8-a5320afe0a3c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:44.746604 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-40fb5891-f93d-45f4-aaf8-a5320afe0a3c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:44.747054 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-40fb5891-f93d-45f4-aaf8-a5320afe0a3c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:44.747822 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-40fb5891-f93d-45f4-aaf8-a5320afe0a3c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:44.748257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-40fb5891-f93d-45f4-aaf8-a5320afe0a3c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:44.811671 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-5f894574-31e5-4cb1-aec4-5d6de956447d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:44.812280 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-5f894574-31e5-4cb1-aec4-5d6de956447d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:44.814761 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=74 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:44.820902 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5f894574-31e5-4cb1-aec4-5d6de956447d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:44.821358 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5f894574-31e5-4cb1-aec4-5d6de956447d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:44.822170 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5f894574-31e5-4cb1-aec4-5d6de956447d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:44.822604 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5f894574-31e5-4cb1-aec4-5d6de956447d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:44.924431 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-40fb5891-f93d-45f4-aaf8-a5320afe0a3c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:44.933032 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-40fb5891-f93d-45f4-aaf8-a5320afe0a3c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:44.934550 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-40fb5891-f93d-45f4-aaf8-a5320afe0a3c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:44.935698 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-40fb5891-f93d-45f4-aaf8-a5320afe0a3c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.201310 Jun 15 14:45:44.936413 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 177/352] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:45:44 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:45:44.963553 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-5f894574-31e5-4cb1-aec4-5d6de956447d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:44.972107 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-5f894574-31e5-4cb1-aec4-5d6de956447d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.164152 Jun 15 14:45:44.972683 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 176/353] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:44 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:45.301442 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-7250c1b8-6a3a-4aa0-88f4-35a687bdf9ab tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:45.302101 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-7250c1b8-6a3a-4aa0-88f4-35a687bdf9ab tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:45.308802 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7250c1b8-6a3a-4aa0-88f4-35a687bdf9ab tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:45.309247 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7250c1b8-6a3a-4aa0-88f4-35a687bdf9ab tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:45.310065 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7250c1b8-6a3a-4aa0-88f4-35a687bdf9ab tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:45.310503 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7250c1b8-6a3a-4aa0-88f4-35a687bdf9ab tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:45.314477 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:45.441620 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-7250c1b8-6a3a-4aa0-88f4-35a687bdf9ab tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:45.449430 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-7250c1b8-6a3a-4aa0-88f4-35a687bdf9ab tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1470 microversion: 2.1 time: 0.151733 Jun 15 14:45:45.450250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 178/354] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:45 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:45.955238 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-ac721a5a-c96a-4638-9910-7af9405084bc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:45.955773 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-ac721a5a-c96a-4638-9910-7af9405084bc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:45.963043 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ac721a5a-c96a-4638-9910-7af9405084bc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:45.963492 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ac721a5a-c96a-4638-9910-7af9405084bc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:45.964510 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ac721a5a-c96a-4638-9910-7af9405084bc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:45.964946 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ac721a5a-c96a-4638-9910-7af9405084bc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:45.989177 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-6c0863b5-a5b4-49f6-945b-94682ed2daa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:45.989823 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-6c0863b5-a5b4-49f6-945b-94682ed2daa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:45.996386 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6c0863b5-a5b4-49f6-945b-94682ed2daa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:45.996837 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6c0863b5-a5b4-49f6-945b-94682ed2daa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:45.997603 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6c0863b5-a5b4-49f6-945b-94682ed2daa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:45.998066 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6c0863b5-a5b4-49f6-945b-94682ed2daa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:46.097920 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ac721a5a-c96a-4638-9910-7af9405084bc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:46.106717 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ac721a5a-c96a-4638-9910-7af9405084bc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:46.108253 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ac721a5a-c96a-4638-9910-7af9405084bc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:46.109420 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-ac721a5a-c96a-4638-9910-7af9405084bc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.158130 Jun 15 14:45:46.110024 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 177/355] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:45:45 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:45:46.133008 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-6c0863b5-a5b4-49f6-945b-94682ed2daa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:46.141856 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-6c0863b5-a5b4-49f6-945b-94682ed2daa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.156506 Jun 15 14:45:46.142427 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 179/356] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:45 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:46.468225 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-753d5ec0-af3a-42d7-9eb3-dfc01e87d78d tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:46.468815 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-753d5ec0-af3a-42d7-9eb3-dfc01e87d78d tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:46.474770 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-753d5ec0-af3a-42d7-9eb3-dfc01e87d78d tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:46.475225 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-753d5ec0-af3a-42d7-9eb3-dfc01e87d78d tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:46.475992 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-753d5ec0-af3a-42d7-9eb3-dfc01e87d78d tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:46.476434 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-753d5ec0-af3a-42d7-9eb3-dfc01e87d78d tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:46.606730 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-753d5ec0-af3a-42d7-9eb3-dfc01e87d78d tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:46.614188 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-753d5ec0-af3a-42d7-9eb3-dfc01e87d78d tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1470 microversion: 2.1 time: 0.150322 Jun 15 14:45:46.614744 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 178/357] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:46 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:47.127998 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-5faae892-b928-462d-b642-c98685798b29 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:47.128727 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-5faae892-b928-462d-b642-c98685798b29 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:47.136115 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5faae892-b928-462d-b642-c98685798b29 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:47.136569 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5faae892-b928-462d-b642-c98685798b29 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:47.137339 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5faae892-b928-462d-b642-c98685798b29 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:47.137804 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5faae892-b928-462d-b642-c98685798b29 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:47.159992 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a2606103-eac6-4d82-94ef-bc692b99df55 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:47.160606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a2606103-eac6-4d82-94ef-bc692b99df55 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:47.166885 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a2606103-eac6-4d82-94ef-bc692b99df55 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:47.167333 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a2606103-eac6-4d82-94ef-bc692b99df55 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:47.168103 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a2606103-eac6-4d82-94ef-bc692b99df55 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:47.168541 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a2606103-eac6-4d82-94ef-bc692b99df55 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:47.282745 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-5faae892-b928-462d-b642-c98685798b29 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:47.295823 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-5faae892-b928-462d-b642-c98685798b29 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:47.297532 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-5faae892-b928-462d-b642-c98685798b29 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:47.298751 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-5faae892-b928-462d-b642-c98685798b29 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.174895 Jun 15 14:45:47.299350 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 180/358] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:45:47 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:45:47.301422 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a2606103-eac6-4d82-94ef-bc692b99df55 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:47.309882 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a2606103-eac6-4d82-94ef-bc692b99df55 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.153735 Jun 15 14:45:47.310533 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 179/359] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:47 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:47.631380 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-13274336-e411-4f39-be83-e89ba5c6577f tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:47.631982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-13274336-e411-4f39-be83-e89ba5c6577f tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:47.638525 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-13274336-e411-4f39-be83-e89ba5c6577f tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:47.639001 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-13274336-e411-4f39-be83-e89ba5c6577f tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:47.639763 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-13274336-e411-4f39-be83-e89ba5c6577f tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:47.640198 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-13274336-e411-4f39-be83-e89ba5c6577f tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:47.782801 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-13274336-e411-4f39-be83-e89ba5c6577f tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:47.791328 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-13274336-e411-4f39-be83-e89ba5c6577f tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1470 microversion: 2.1 time: 0.163862 Jun 15 14:45:47.791889 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 181/360] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:47 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:48.318105 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-fc32b5c0-29ac-4332-8574-d0eb9097010d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:48.318730 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-fc32b5c0-29ac-4332-8574-d0eb9097010d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:48.330777 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-eeb6e5f6-897a-411a-9f8d-ff18b5d2c6cb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:48.334054 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-eeb6e5f6-897a-411a-9f8d-ff18b5d2c6cb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:48.334286 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fc32b5c0-29ac-4332-8574-d0eb9097010d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:48.334748 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fc32b5c0-29ac-4332-8574-d0eb9097010d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:48.335824 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fc32b5c0-29ac-4332-8574-d0eb9097010d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:48.336270 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fc32b5c0-29ac-4332-8574-d0eb9097010d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:48.343551 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-eeb6e5f6-897a-411a-9f8d-ff18b5d2c6cb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:48.344009 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-eeb6e5f6-897a-411a-9f8d-ff18b5d2c6cb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:48.344809 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-eeb6e5f6-897a-411a-9f8d-ff18b5d2c6cb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:48.345236 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-eeb6e5f6-897a-411a-9f8d-ff18b5d2c6cb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:48.486966 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-fc32b5c0-29ac-4332-8574-d0eb9097010d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:48.494373 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=100 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:48.499047 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-fc32b5c0-29ac-4332-8574-d0eb9097010d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:48.500779 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-fc32b5c0-29ac-4332-8574-d0eb9097010d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:48.502092 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-fc32b5c0-29ac-4332-8574-d0eb9097010d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.187896 Jun 15 14:45:48.502679 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 180/361] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:45:48 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:45:48.538221 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-eeb6e5f6-897a-411a-9f8d-ff18b5d2c6cb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:48.546797 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-eeb6e5f6-897a-411a-9f8d-ff18b5d2c6cb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.223320 Jun 15 14:45:48.547590 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 182/362] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:48 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:48.808626 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-13882b56-f6ce-45e5-9f9a-63e412e85d15 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:48.809344 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-13882b56-f6ce-45e5-9f9a-63e412e85d15 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:48.815779 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-13882b56-f6ce-45e5-9f9a-63e412e85d15 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:48.816228 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-13882b56-f6ce-45e5-9f9a-63e412e85d15 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:48.817049 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-13882b56-f6ce-45e5-9f9a-63e412e85d15 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:48.817487 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-13882b56-f6ce-45e5-9f9a-63e412e85d15 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:48.957811 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-13882b56-f6ce-45e5-9f9a-63e412e85d15 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:48.965844 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-13882b56-f6ce-45e5-9f9a-63e412e85d15 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1470 microversion: 2.1 time: 0.162053 Jun 15 14:45:48.966492 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 181/363] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:48 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:49.522237 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-deb0ee7a-e6a8-4318-9145-e0c73d02468b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:49.522844 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-deb0ee7a-e6a8-4318-9145-e0c73d02468b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:49.530533 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-deb0ee7a-e6a8-4318-9145-e0c73d02468b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:49.531086 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-deb0ee7a-e6a8-4318-9145-e0c73d02468b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:49.531924 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-deb0ee7a-e6a8-4318-9145-e0c73d02468b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:49.532424 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-deb0ee7a-e6a8-4318-9145-e0c73d02468b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:49.564199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1be214d9-6de6-4d03-9968-f14c8114192d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:49.565443 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1be214d9-6de6-4d03-9968-f14c8114192d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:49.574003 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1be214d9-6de6-4d03-9968-f14c8114192d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:49.574682 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1be214d9-6de6-4d03-9968-f14c8114192d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:49.575633 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1be214d9-6de6-4d03-9968-f14c8114192d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:49.576231 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1be214d9-6de6-4d03-9968-f14c8114192d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:49.675978 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-deb0ee7a-e6a8-4318-9145-e0c73d02468b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:49.685292 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-deb0ee7a-e6a8-4318-9145-e0c73d02468b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:49.686834 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-deb0ee7a-e6a8-4318-9145-e0c73d02468b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:49.688084 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-deb0ee7a-e6a8-4318-9145-e0c73d02468b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.169693 Jun 15 14:45:49.688714 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 183/364] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:45:49 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:45:49.769280 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-1be214d9-6de6-4d03-9968-f14c8114192d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:49.778026 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-1be214d9-6de6-4d03-9968-f14c8114192d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.217562 Jun 15 14:45:49.778601 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 182/365] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:49 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:49.905111 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-98c59217-3c2e-45de-a479-7e54ccb24829 req-c195ab92-9146-4b0a-a1e8-362c2c05e1d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3084f10-2f71-49d3-9b8f-b05204b12bdc", "name": "network-vif-deleted", "tag": "9b5a249e-fa51-4473-98b3-2016938ad6ec"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:45:49.913242 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-98c59217-3c2e-45de-a479-7e54ccb24829 req-c195ab92-9146-4b0a-a1e8-362c2c05e1d6 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:49.913701 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-98c59217-3c2e-45de-a479-7e54ccb24829 req-c195ab92-9146-4b0a-a1e8-362c2c05e1d6 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:49.925445 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-98c59217-3c2e-45de-a479-7e54ccb24829 req-c195ab92-9146-4b0a-a1e8-362c2c05e1d6 service nova] Creating event network-vif-deleted:9b5a249e-fa51-4473-98b3-2016938ad6ec for instance b3084f10-2f71-49d3-9b8f-b05204b12bdc on hv-cinder-84327 Jun 15 14:45:49.931283 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-98c59217-3c2e-45de-a479-7e54ccb24829 req-c195ab92-9146-4b0a-a1e8-362c2c05e1d6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029241 Jun 15 14:45:49.932239 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 184/366] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:45:49.983021 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-04c44a0f-4f9b-4182-b823-83db4ad29ca2 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:49.983644 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-04c44a0f-4f9b-4182-b823-83db4ad29ca2 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:49.989967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-04c44a0f-4f9b-4182-b823-83db4ad29ca2 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:49.990415 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-04c44a0f-4f9b-4182-b823-83db4ad29ca2 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:49.991233 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-04c44a0f-4f9b-4182-b823-83db4ad29ca2 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:49.991599 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-04c44a0f-4f9b-4182-b823-83db4ad29ca2 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:50.056504 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-04c44a0f-4f9b-4182-b823-83db4ad29ca2 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:50.064151 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-04c44a0f-4f9b-4182-b823-83db4ad29ca2 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1428 microversion: 2.1 time: 0.085167 Jun 15 14:45:50.064718 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 183/367] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:49 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1428 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:50.142328 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-aa5834cd-3770-4e7d-b273-023398330b57 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:45:50.148671 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-aa5834cd-3770-4e7d-b273-023398330b57 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:50.149196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-aa5834cd-3770-4e7d-b273-023398330b57 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:50.211980 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-aa5834cd-3770-4e7d-b273-023398330b57 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Going to try to stop instance {{(pid=124219) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 15 14:45:50.258049 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-aa5834cd-3770-4e7d-b273-023398330b57 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "POST /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b/action" status: 202 len: 0 microversion: 2.1 time: 0.119852 Jun 15 14:45:50.258768 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 185/368] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 14:45:50 2022] POST /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:45:50.267161 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-400dc8de-9dd1-4816-a3b4-eed74cc097e9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:50.267776 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-400dc8de-9dd1-4816-a3b4-eed74cc097e9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:50.273782 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-400dc8de-9dd1-4816-a3b4-eed74cc097e9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:50.274394 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-400dc8de-9dd1-4816-a3b4-eed74cc097e9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:50.275018 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-400dc8de-9dd1-4816-a3b4-eed74cc097e9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:50.275453 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-400dc8de-9dd1-4816-a3b4-eed74cc097e9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:50.415667 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-400dc8de-9dd1-4816-a3b4-eed74cc097e9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:50.424829 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-400dc8de-9dd1-4816-a3b4-eed74cc097e9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1725 microversion: 2.1 time: 0.161360 Jun 15 14:45:50.425409 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 184/369] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:50 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:50.708191 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-9081fdd6-b7f8-4ead-906d-be1e61478566 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:50.708903 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-9081fdd6-b7f8-4ead-906d-be1e61478566 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:50.716254 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9081fdd6-b7f8-4ead-906d-be1e61478566 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:50.716706 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9081fdd6-b7f8-4ead-906d-be1e61478566 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:50.717480 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9081fdd6-b7f8-4ead-906d-be1e61478566 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:50.717940 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9081fdd6-b7f8-4ead-906d-be1e61478566 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:50.795408 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-31b1fb1a-585c-4edf-bcb2-abf1a57817c1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:50.796213 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-31b1fb1a-585c-4edf-bcb2-abf1a57817c1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:50.802718 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-31b1fb1a-585c-4edf-bcb2-abf1a57817c1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:50.803159 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-31b1fb1a-585c-4edf-bcb2-abf1a57817c1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:50.803915 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-31b1fb1a-585c-4edf-bcb2-abf1a57817c1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:50.804342 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-31b1fb1a-585c-4edf-bcb2-abf1a57817c1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:50.863134 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-9081fdd6-b7f8-4ead-906d-be1e61478566 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:50.871597 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-9081fdd6-b7f8-4ead-906d-be1e61478566 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:50.873280 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-9081fdd6-b7f8-4ead-906d-be1e61478566 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:50.874599 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-9081fdd6-b7f8-4ead-906d-be1e61478566 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.171419 Jun 15 14:45:50.875317 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 186/370] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:45:50 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:45:50.959610 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-31b1fb1a-585c-4edf-bcb2-abf1a57817c1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:50.968654 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-31b1fb1a-585c-4edf-bcb2-abf1a57817c1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.177055 Jun 15 14:45:50.969213 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 185/371] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:50 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:51.081054 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-5e2ca5a0-76fc-4dd2-9f05-ff1a8863f254 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:51.081682 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-5e2ca5a0-76fc-4dd2-9f05-ff1a8863f254 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:51.088271 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5e2ca5a0-76fc-4dd2-9f05-ff1a8863f254 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:51.088724 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5e2ca5a0-76fc-4dd2-9f05-ff1a8863f254 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:51.089775 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5e2ca5a0-76fc-4dd2-9f05-ff1a8863f254 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:51.090218 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5e2ca5a0-76fc-4dd2-9f05-ff1a8863f254 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:51.120389 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5e2ca5a0-76fc-4dd2-9f05-ff1a8863f254 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:51.120843 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5e2ca5a0-76fc-4dd2-9f05-ff1a8863f254 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:51.121301 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.objects.instance [None req-5e2ca5a0-76fc-4dd2-9f05-ff1a8863f254 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lazy-loading 'fault' on Instance uuid b3084f10-2f71-49d3-9b8f-b05204b12bdc {{(pid=124219) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:45:51.161830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-5e2ca5a0-76fc-4dd2-9f05-ff1a8863f254 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6eaf2c133743a08314ca0d9dcc59a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57bab77e60b4efc9df43e95f1ead38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:51.169379 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-5e2ca5a0-76fc-4dd2-9f05-ff1a8863f254 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 200 len: 1304 microversion: 2.1 time: 0.092138 Jun 15 14:45:51.169970 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 187/372] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:51 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:51.443210 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-60a4846f-2696-404d-805c-9436844a7f62 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:51.443716 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-60a4846f-2696-404d-805c-9436844a7f62 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:51.450744 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-60a4846f-2696-404d-805c-9436844a7f62 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:51.451188 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-60a4846f-2696-404d-805c-9436844a7f62 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:51.451948 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-60a4846f-2696-404d-805c-9436844a7f62 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:51.452377 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-60a4846f-2696-404d-805c-9436844a7f62 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:51.586270 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-60a4846f-2696-404d-805c-9436844a7f62 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:51.594820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-60a4846f-2696-404d-805c-9436844a7f62 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1725 microversion: 2.1 time: 0.155513 Jun 15 14:45:51.595379 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 186/373] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:51 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:51.893776 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-ac82a0fc-8c79-468a-8e46-d71bc9dd2cda tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:51.894600 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-ac82a0fc-8c79-468a-8e46-d71bc9dd2cda tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:51.901353 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ac82a0fc-8c79-468a-8e46-d71bc9dd2cda tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:51.902079 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ac82a0fc-8c79-468a-8e46-d71bc9dd2cda tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:51.903230 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ac82a0fc-8c79-468a-8e46-d71bc9dd2cda tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:51.903759 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ac82a0fc-8c79-468a-8e46-d71bc9dd2cda tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:51.986425 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-481af86c-e710-425d-93aa-250a9471316e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:51.987103 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-481af86c-e710-425d-93aa-250a9471316e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:51.997026 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-481af86c-e710-425d-93aa-250a9471316e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:52.005927 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-481af86c-e710-425d-93aa-250a9471316e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:52.006929 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-481af86c-e710-425d-93aa-250a9471316e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:52.007362 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-481af86c-e710-425d-93aa-250a9471316e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:52.178461 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-481af86c-e710-425d-93aa-250a9471316e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:52.189902 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-481af86c-e710-425d-93aa-250a9471316e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.207150 Jun 15 14:45:52.203991 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 187/374] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:51 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:52.212178 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-0712f6dc-87f1-43e1-9a4d-2e54913f28e8 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:52.213101 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-0712f6dc-87f1-43e1-9a4d-2e54913f28e8 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] [instance: b3084f10-2f71-49d3-9b8f-b05204b12bdc] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:52.220003 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0712f6dc-87f1-43e1-9a4d-2e54913f28e8 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:52.220543 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0712f6dc-87f1-43e1-9a4d-2e54913f28e8 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:52.221414 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0712f6dc-87f1-43e1-9a4d-2e54913f28e8 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:52.221958 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0712f6dc-87f1-43e1-9a4d-2e54913f28e8 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:52.237960 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.wsgi [None req-0712f6dc-87f1-43e1-9a4d-2e54913f28e8 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] HTTP exception thrown: Instance b3084f10-2f71-49d3-9b8f-b05204b12bdc could not be found. Jun 15 14:45:52.239728 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-0712f6dc-87f1-43e1-9a4d-2e54913f28e8 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Request method failure captured: Jun 15 14:45:52.239728 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: request: GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc HTTP/1.1 Jun 15 14:45:52.239728 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept: application/json Jun 15 14:45:52.239728 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept-Encoding: identity Jun 15 14:45:52.239728 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Connection: close Jun 15 14:45:52.239728 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Length: 0 Jun 15 14:45:52.239728 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Type: application/json Jun 15 14:45:52.239728 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Host: 10.222.0.57 Jun 15 14:45:52.239728 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Openstack-System-Scope: None Jun 15 14:45:52.239728 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: User-Agent: python-urllib3/1.26.9 Jun 15 14:45:52.239728 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Auth-Token: gAAAAABiqfB5Ebp_vcJ6uI31okMQL02J5zwIIr-Ja5TSC3M4hqqJ9vpoD4uqR6zpZXobgtnw56BZYj2jgRJSA65X7T9WGvhMbLL3BykpV-HQkX6JWUkSiZ9R3niyCIVzq5OZHOmw-7uNumYBGF1iW5fHEo61N0abNWhQzVRm6SNVy6l019y3cBI Jun 15 14:45:52.239728 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Id: None Jun 15 14:45:52.239728 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Name: None Jun 15 14:45:52.239728 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Identity-Status: Confirmed Jun 15 14:45:52.239728 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Is-Admin-Project: True Jun 15 14:45:52.239728 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Id: default Jun 15 14:45:52.239728 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Name: Default Jun 15 14:45:52.239728 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Id: a57bab77e60b4efc9df43e95f1ead38b Jun 15 14:45:52.239728 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Name: tempest-VolumesNegativeTest-1395028658 Jun 15 14:45:52.239728 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Role: member,reader Jun 15 14:45:52.239728 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Roles: member,reader Jun 15 14:45:52.241056 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a57bab77e60b4efc9df43e95f1ead38b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_a57bab77e60b4efc9df43e95f1ead38b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/a57bab77e60b4efc9df43e95f1ead38b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a57bab77e60b4efc9df43e95f1ead38b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:45:52.241056 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant: tempest-VolumesNegativeTest-1395028658 Jun 15 14:45:52.241056 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Id: a57bab77e60b4efc9df43e95f1ead38b Jun 15 14:45:52.241056 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Name: tempest-VolumesNegativeTest-1395028658 Jun 15 14:45:52.241056 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User: tempest-VolumesNegativeTest-1395028658-project Jun 15 14:45:52.241056 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Id: default Jun 15 14:45:52.241056 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Name: Default Jun 15 14:45:52.241056 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Id: 7d6eaf2c133743a08314ca0d9dcc59a8 Jun 15 14:45:52.241056 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Name: tempest-VolumesNegativeTest-1395028658-project Jun 15 14:45:52.241056 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: method: > Jun 15 14:45:52.241056 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: exception: Instance b3084f10-2f71-49d3-9b8f-b05204b12bdc could not be found. Jun 15 14:45:52.241056 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: action_args: {'id': 'b3084f10-2f71-49d3-9b8f-b05204b12bdc'} Jun 15 14:45:52.241804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:45:52.241804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:45:52.241804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:45:52.241804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:45:52.241804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:45:52.241804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:45:52.241804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:45:52.241804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:45:52.241804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:45:52.241804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:45:52.241804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3084f10-2f71-49d3-9b8f-b05204b12bdc could not be found. Jun 15 14:45:52.241804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:45:52.241804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:45:52.241804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:45:52.241804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:45:52.241804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:45:52.241804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:45:52.241804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:45:52.241804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:45:52.241804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:45:52.243129 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:45:52.243129 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:45:52.243129 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:45:52.243129 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:45:52.243129 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:45:52.243129 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:45:52.243129 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:45:52.243129 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3084f10-2f71-49d3-9b8f-b05204b12bdc could not be found. Jun 15 14:45:52.243129 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:45:52.243129 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:45:52.243129 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:45:52.243129 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:45:52.243129 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:45:52.243129 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:45:52.243129 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:45:52.243129 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:45:52.243129 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3084f10-2f71-49d3-9b8f-b05204b12bdc could not be found. Jun 15 14:45:52.243129 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:45:52.244397 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-0712f6dc-87f1-43e1-9a4d-2e54913f28e8 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] Returning 404 to user: Instance b3084f10-2f71-49d3-9b8f-b05204b12bdc could not be found. {{(pid=124220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:45:52.244397 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-0712f6dc-87f1-43e1-9a4d-2e54913f28e8 tempest-VolumesNegativeTest-1395028658 tempest-VolumesNegativeTest-1395028658-project] 10.222.0.57 "GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc" status: 404 len: 111 microversion: 2.1 time: 0.034800 Jun 15 14:45:52.245511 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 188/375] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:52 2022] GET /compute/v2.1/servers/b3084f10-2f71-49d3-9b8f-b05204b12bdc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:45:52.342489 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-ac82a0fc-8c79-468a-8e46-d71bc9dd2cda tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:52.350958 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-ac82a0fc-8c79-468a-8e46-d71bc9dd2cda tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:52.353047 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-ac82a0fc-8c79-468a-8e46-d71bc9dd2cda tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:52.354258 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-ac82a0fc-8c79-468a-8e46-d71bc9dd2cda tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.464445 Jun 15 14:45:52.354819 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 188/376] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:45:51 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:45:52.614275 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-5bf68591-cb75-4319-9e2b-a3932a63d4e2 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:52.615209 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-5bf68591-cb75-4319-9e2b-a3932a63d4e2 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:52.622933 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5bf68591-cb75-4319-9e2b-a3932a63d4e2 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:52.623386 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5bf68591-cb75-4319-9e2b-a3932a63d4e2 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:52.624172 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5bf68591-cb75-4319-9e2b-a3932a63d4e2 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:52.624613 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5bf68591-cb75-4319-9e2b-a3932a63d4e2 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:52.791651 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-5bf68591-cb75-4319-9e2b-a3932a63d4e2 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:52.801549 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-5bf68591-cb75-4319-9e2b-a3932a63d4e2 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1725 microversion: 2.1 time: 0.192921 Jun 15 14:45:52.802231 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 189/377] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:52 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:53.206895 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3e99cec1-4816-48f0-b3f1-10a92a7f9e37 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:53.207537 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-3e99cec1-4816-48f0-b3f1-10a92a7f9e37 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:53.215837 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3e99cec1-4816-48f0-b3f1-10a92a7f9e37 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:53.216335 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3e99cec1-4816-48f0-b3f1-10a92a7f9e37 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:53.217505 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3e99cec1-4816-48f0-b3f1-10a92a7f9e37 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:53.217967 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3e99cec1-4816-48f0-b3f1-10a92a7f9e37 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:53.378077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-dbcf516e-119f-4618-ada1-df69221f2002 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:53.378746 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-3e99cec1-4816-48f0-b3f1-10a92a7f9e37 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:53.379082 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-dbcf516e-119f-4618-ada1-df69221f2002 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:53.386277 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-dbcf516e-119f-4618-ada1-df69221f2002 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:53.387005 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-dbcf516e-119f-4618-ada1-df69221f2002 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:53.388105 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-3e99cec1-4816-48f0-b3f1-10a92a7f9e37 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.184980 Jun 15 14:45:53.388338 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-dbcf516e-119f-4618-ada1-df69221f2002 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:53.389174 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-dbcf516e-119f-4618-ada1-df69221f2002 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:53.389524 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 189/378] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:53 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:53.548174 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-dbcf516e-119f-4618-ada1-df69221f2002 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:53.556741 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-dbcf516e-119f-4618-ada1-df69221f2002 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:53.558298 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-dbcf516e-119f-4618-ada1-df69221f2002 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:53.559476 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-dbcf516e-119f-4618-ada1-df69221f2002 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.190191 Jun 15 14:45:53.560092 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 190/379] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:45:53 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:45:53.818692 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-5a239ff4-b85b-4152-a27f-17f7b3c64ee5 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:53.819296 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-5a239ff4-b85b-4152-a27f-17f7b3c64ee5 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:53.826167 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5a239ff4-b85b-4152-a27f-17f7b3c64ee5 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:53.826673 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5a239ff4-b85b-4152-a27f-17f7b3c64ee5 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:53.827443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5a239ff4-b85b-4152-a27f-17f7b3c64ee5 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:53.828047 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5a239ff4-b85b-4152-a27f-17f7b3c64ee5 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:54.079541 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-5a239ff4-b85b-4152-a27f-17f7b3c64ee5 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:54.090849 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-5a239ff4-b85b-4152-a27f-17f7b3c64ee5 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1725 microversion: 2.1 time: 0.275803 Jun 15 14:45:54.091706 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 190/380] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:53 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1725 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:54.406174 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-b3d52bf5-a6f3-4f9a-a1aa-62e24e15b28d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:54.406933 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-b3d52bf5-a6f3-4f9a-a1aa-62e24e15b28d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:54.415798 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b3d52bf5-a6f3-4f9a-a1aa-62e24e15b28d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:54.418005 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b3d52bf5-a6f3-4f9a-a1aa-62e24e15b28d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:54.419352 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b3d52bf5-a6f3-4f9a-a1aa-62e24e15b28d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:54.419889 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b3d52bf5-a6f3-4f9a-a1aa-62e24e15b28d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:54.577383 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-d39d03a9-90a1-4baa-b4a9-8be7fa13b0ba tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:54.578135 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-d39d03a9-90a1-4baa-b4a9-8be7fa13b0ba tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:54.590050 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d39d03a9-90a1-4baa-b4a9-8be7fa13b0ba tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:54.591347 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d39d03a9-90a1-4baa-b4a9-8be7fa13b0ba tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:54.592284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d39d03a9-90a1-4baa-b4a9-8be7fa13b0ba tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:54.592869 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d39d03a9-90a1-4baa-b4a9-8be7fa13b0ba tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:54.715540 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-b3d52bf5-a6f3-4f9a-a1aa-62e24e15b28d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:54.724851 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-b3d52bf5-a6f3-4f9a-a1aa-62e24e15b28d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.322312 Jun 15 14:45:54.726653 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 191/381] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:54 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:54.886104 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d39d03a9-90a1-4baa-b4a9-8be7fa13b0ba tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:54.896643 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d39d03a9-90a1-4baa-b4a9-8be7fa13b0ba tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:54.898635 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d39d03a9-90a1-4baa-b4a9-8be7fa13b0ba tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:54.902542 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-d39d03a9-90a1-4baa-b4a9-8be7fa13b0ba tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.329166 Jun 15 14:45:54.903610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 191/382] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:45:54 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:45:55.108805 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-d658e0fd-9b2c-40dc-a40f-79d54a6f6864 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:55.109423 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-d658e0fd-9b2c-40dc-a40f-79d54a6f6864 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:55.115454 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d658e0fd-9b2c-40dc-a40f-79d54a6f6864 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:55.116076 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d658e0fd-9b2c-40dc-a40f-79d54a6f6864 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:55.117559 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d658e0fd-9b2c-40dc-a40f-79d54a6f6864 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:55.118848 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d658e0fd-9b2c-40dc-a40f-79d54a6f6864 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:55.305243 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-d658e0fd-9b2c-40dc-a40f-79d54a6f6864 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:55.315124 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-d658e0fd-9b2c-40dc-a40f-79d54a6f6864 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1725 microversion: 2.1 time: 0.210040 Jun 15 14:45:55.316030 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 192/383] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:55 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1725 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:55.747340 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-801e9100-b263-4cb5-a538-a9707d4af261 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:55.748161 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-801e9100-b263-4cb5-a538-a9707d4af261 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:55.750913 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:55.758297 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-801e9100-b263-4cb5-a538-a9707d4af261 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:55.759381 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-801e9100-b263-4cb5-a538-a9707d4af261 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:55.761220 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-801e9100-b263-4cb5-a538-a9707d4af261 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:55.761852 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-801e9100-b263-4cb5-a538-a9707d4af261 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:55.920961 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6859f2a2-231b-4f23-8225-da9b991d678d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:55.921844 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6859f2a2-231b-4f23-8225-da9b991d678d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:55.928462 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6859f2a2-231b-4f23-8225-da9b991d678d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:55.928949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6859f2a2-231b-4f23-8225-da9b991d678d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:55.929817 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6859f2a2-231b-4f23-8225-da9b991d678d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:55.930256 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6859f2a2-231b-4f23-8225-da9b991d678d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:56.040838 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-801e9100-b263-4cb5-a538-a9707d4af261 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:56.049149 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-801e9100-b263-4cb5-a538-a9707d4af261 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.311565 Jun 15 14:45:56.049751 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 192/384] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:55 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:56.089702 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6859f2a2-231b-4f23-8225-da9b991d678d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:56.107426 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6859f2a2-231b-4f23-8225-da9b991d678d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:56.109016 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6859f2a2-231b-4f23-8225-da9b991d678d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:56.111529 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-6859f2a2-231b-4f23-8225-da9b991d678d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.194834 Jun 15 14:45:56.115885 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 193/385] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:45:55 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:45:56.332423 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-7004ec5b-3967-4e51-bac2-780eff64f6be tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:56.333389 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-7004ec5b-3967-4e51-bac2-780eff64f6be tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:56.340067 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7004ec5b-3967-4e51-bac2-780eff64f6be tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:56.340735 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7004ec5b-3967-4e51-bac2-780eff64f6be tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:56.341711 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7004ec5b-3967-4e51-bac2-780eff64f6be tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:56.342432 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7004ec5b-3967-4e51-bac2-780eff64f6be tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:56.522894 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-7004ec5b-3967-4e51-bac2-780eff64f6be tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:56.531520 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-7004ec5b-3967-4e51-bac2-780eff64f6be tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1725 microversion: 2.1 time: 0.203452 Jun 15 14:45:56.545814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 193/386] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:56 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:45:57.067573 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-9be825ca-745c-4f69-b060-c45078d18a45 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:57.068210 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-9be825ca-745c-4f69-b060-c45078d18a45 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:57.078790 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9be825ca-745c-4f69-b060-c45078d18a45 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:57.080963 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9be825ca-745c-4f69-b060-c45078d18a45 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:57.082822 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9be825ca-745c-4f69-b060-c45078d18a45 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:57.083974 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9be825ca-745c-4f69-b060-c45078d18a45 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:57.137251 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-4fefbe14-3c36-4cdc-8c60-ebba5a00440a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:57.137994 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-4fefbe14-3c36-4cdc-8c60-ebba5a00440a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:57.147949 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4fefbe14-3c36-4cdc-8c60-ebba5a00440a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:57.148611 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4fefbe14-3c36-4cdc-8c60-ebba5a00440a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:57.150178 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4fefbe14-3c36-4cdc-8c60-ebba5a00440a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:57.150781 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4fefbe14-3c36-4cdc-8c60-ebba5a00440a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:57.174923 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:45:57.274037 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9be825ca-745c-4f69-b060-c45078d18a45 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:57.284725 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-9be825ca-745c-4f69-b060-c45078d18a45 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.221395 Jun 15 14:45:57.285569 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 194/387] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:57 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:57.333024 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-4fefbe14-3c36-4cdc-8c60-ebba5a00440a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:57.345858 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-4fefbe14-3c36-4cdc-8c60-ebba5a00440a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:57.347624 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-4fefbe14-3c36-4cdc-8c60-ebba5a00440a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:57.349549 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-4fefbe14-3c36-4cdc-8c60-ebba5a00440a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.216630 Jun 15 14:45:57.351013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 194/388] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:45:57 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:45:57.550921 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-72b08bbd-a43a-4066-892f-ca289a661f09 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:57.551766 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-72b08bbd-a43a-4066-892f-ca289a661f09 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:57.566244 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-72b08bbd-a43a-4066-892f-ca289a661f09 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:57.570821 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-72b08bbd-a43a-4066-892f-ca289a661f09 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:57.576263 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-72b08bbd-a43a-4066-892f-ca289a661f09 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:57.579325 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-72b08bbd-a43a-4066-892f-ca289a661f09 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:57.975821 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-72b08bbd-a43a-4066-892f-ca289a661f09 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:58.001304 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-72b08bbd-a43a-4066-892f-ca289a661f09 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1725 microversion: 2.1 time: 0.455597 Jun 15 14:45:58.010114 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 195/389] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:57 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1725 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:58.304217 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-53e737ca-7e4d-4322-9aa9-7f073ff8ff1d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:58.304946 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-53e737ca-7e4d-4322-9aa9-7f073ff8ff1d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:58.318934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-53e737ca-7e4d-4322-9aa9-7f073ff8ff1d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:58.319614 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-53e737ca-7e4d-4322-9aa9-7f073ff8ff1d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:58.320382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-53e737ca-7e4d-4322-9aa9-7f073ff8ff1d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:58.320930 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-53e737ca-7e4d-4322-9aa9-7f073ff8ff1d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:58.376766 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-5f7fa6a9-e772-4b0a-af0c-9371cc512fd0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:58.378884 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-5f7fa6a9-e772-4b0a-af0c-9371cc512fd0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:58.436382 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5f7fa6a9-e772-4b0a-af0c-9371cc512fd0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:58.436886 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5f7fa6a9-e772-4b0a-af0c-9371cc512fd0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:58.437790 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5f7fa6a9-e772-4b0a-af0c-9371cc512fd0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:58.438239 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5f7fa6a9-e772-4b0a-af0c-9371cc512fd0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:58.587881 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-53e737ca-7e4d-4322-9aa9-7f073ff8ff1d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:58.603344 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-53e737ca-7e4d-4322-9aa9-7f073ff8ff1d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.303273 Jun 15 14:45:58.621408 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 195/390] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:58 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:58.813395 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-5f7fa6a9-e772-4b0a-af0c-9371cc512fd0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:58.838608 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-5f7fa6a9-e772-4b0a-af0c-9371cc512fd0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:58.843069 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-5f7fa6a9-e772-4b0a-af0c-9371cc512fd0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:58.852760 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-5f7fa6a9-e772-4b0a-af0c-9371cc512fd0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.481372 Jun 15 14:45:58.853476 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 196/391] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:45:58 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:45:59.019945 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-40da7b38-aea0-4462-bd8d-2f5c3c428e71 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:59.020632 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-40da7b38-aea0-4462-bd8d-2f5c3c428e71 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:59.028386 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-40da7b38-aea0-4462-bd8d-2f5c3c428e71 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:59.028941 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-40da7b38-aea0-4462-bd8d-2f5c3c428e71 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:59.029870 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-40da7b38-aea0-4462-bd8d-2f5c3c428e71 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:59.030484 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-40da7b38-aea0-4462-bd8d-2f5c3c428e71 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:59.249777 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-40da7b38-aea0-4462-bd8d-2f5c3c428e71 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:59.265056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-40da7b38-aea0-4462-bd8d-2f5c3c428e71 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1725 microversion: 2.1 time: 0.249022 Jun 15 14:45:59.265935 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 196/392] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:59 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1725 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:59.620606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-85407646-2048-4f82-94bb-4c2248da5d27 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:59.621887 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-85407646-2048-4f82-94bb-4c2248da5d27 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:59.628777 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-85407646-2048-4f82-94bb-4c2248da5d27 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:59.629481 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-85407646-2048-4f82-94bb-4c2248da5d27 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:59.630562 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-85407646-2048-4f82-94bb-4c2248da5d27 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:59.631001 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-85407646-2048-4f82-94bb-4c2248da5d27 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:59.824820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-85407646-2048-4f82-94bb-4c2248da5d27 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:45:59.835219 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-85407646-2048-4f82-94bb-4c2248da5d27 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.218640 Jun 15 14:45:59.836392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 197/393] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:45:59 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:45:59.875177 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-b0b4965e-d41a-4ef1-9bf3-eb221a533540 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:45:59.876636 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-b0b4965e-d41a-4ef1-9bf3-eb221a533540 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:45:59.890626 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b0b4965e-d41a-4ef1-9bf3-eb221a533540 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:59.892119 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b0b4965e-d41a-4ef1-9bf3-eb221a533540 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:45:59.894149 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b0b4965e-d41a-4ef1-9bf3-eb221a533540 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:45:59.895112 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b0b4965e-d41a-4ef1-9bf3-eb221a533540 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:00.220790 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b0b4965e-d41a-4ef1-9bf3-eb221a533540 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:00.230611 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b0b4965e-d41a-4ef1-9bf3-eb221a533540 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:00.232126 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b0b4965e-d41a-4ef1-9bf3-eb221a533540 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:00.233334 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-b0b4965e-d41a-4ef1-9bf3-eb221a533540 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.365536 Jun 15 14:46:00.244985 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 197/394] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:45:59 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:00.287412 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-903fe06b-085a-4b6c-a0b5-87d600a18959 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:00.289264 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-903fe06b-085a-4b6c-a0b5-87d600a18959 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:00.299612 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-903fe06b-085a-4b6c-a0b5-87d600a18959 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:00.301461 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-903fe06b-085a-4b6c-a0b5-87d600a18959 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:00.302379 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-903fe06b-085a-4b6c-a0b5-87d600a18959 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:00.303044 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-903fe06b-085a-4b6c-a0b5-87d600a18959 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:00.308100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=100 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:00.675121 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-903fe06b-085a-4b6c-a0b5-87d600a18959 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:00.695129 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-903fe06b-085a-4b6c-a0b5-87d600a18959 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1725 microversion: 2.1 time: 0.412134 Jun 15 14:46:00.702669 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 198/395] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:00 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1725 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:00.856325 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e37bafda-5327-4725-83cb-da31e40751b9 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:00.857562 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-e37bafda-5327-4725-83cb-da31e40751b9 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:00.869715 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e37bafda-5327-4725-83cb-da31e40751b9 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:00.870482 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e37bafda-5327-4725-83cb-da31e40751b9 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:00.871533 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e37bafda-5327-4725-83cb-da31e40751b9 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:00.872979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e37bafda-5327-4725-83cb-da31e40751b9 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:01.257331 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-ffa54f83-6a4b-4d2e-bbe1-e5590250380f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:01.258892 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-ffa54f83-6a4b-4d2e-bbe1-e5590250380f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:01.267609 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ffa54f83-6a4b-4d2e-bbe1-e5590250380f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:01.268521 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ffa54f83-6a4b-4d2e-bbe1-e5590250380f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:01.270654 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ffa54f83-6a4b-4d2e-bbe1-e5590250380f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:01.271396 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ffa54f83-6a4b-4d2e-bbe1-e5590250380f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:01.325736 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e37bafda-5327-4725-83cb-da31e40751b9 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:01.338398 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-e37bafda-5327-4725-83cb-da31e40751b9 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.487747 Jun 15 14:46:01.340231 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 198/396] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:00 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:01.508402 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ffa54f83-6a4b-4d2e-bbe1-e5590250380f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:01.544849 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ffa54f83-6a4b-4d2e-bbe1-e5590250380f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:01.550174 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ffa54f83-6a4b-4d2e-bbe1-e5590250380f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:01.553909 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-ffa54f83-6a4b-4d2e-bbe1-e5590250380f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.304570 Jun 15 14:46:01.555080 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 199/397] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:01 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:46:01.728714 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-2e775a24-4bf2-4c70-94cb-5f421e686137 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:01.729355 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-2e775a24-4bf2-4c70-94cb-5f421e686137 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:01.747089 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2e775a24-4bf2-4c70-94cb-5f421e686137 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:01.749336 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2e775a24-4bf2-4c70-94cb-5f421e686137 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:01.754374 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2e775a24-4bf2-4c70-94cb-5f421e686137 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:01.754942 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2e775a24-4bf2-4c70-94cb-5f421e686137 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:02.112600 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-2e775a24-4bf2-4c70-94cb-5f421e686137 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:02.124778 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-2e775a24-4bf2-4c70-94cb-5f421e686137 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1725 microversion: 2.1 time: 0.408654 Jun 15 14:46:02.137546 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 199/398] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:01 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1725 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:02.357800 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-aa5d9e3b-619a-4efc-b1bb-10545fac5629 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:02.359368 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-aa5d9e3b-619a-4efc-b1bb-10545fac5629 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:02.372033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-aa5d9e3b-619a-4efc-b1bb-10545fac5629 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:02.372491 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-aa5d9e3b-619a-4efc-b1bb-10545fac5629 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:02.378943 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-aa5d9e3b-619a-4efc-b1bb-10545fac5629 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:02.379653 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-aa5d9e3b-619a-4efc-b1bb-10545fac5629 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:02.576222 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-d148fec2-dafd-4972-9de1-6f216c0a020f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:02.577804 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-d148fec2-dafd-4972-9de1-6f216c0a020f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:02.586755 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d148fec2-dafd-4972-9de1-6f216c0a020f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:02.591539 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d148fec2-dafd-4972-9de1-6f216c0a020f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:02.592549 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d148fec2-dafd-4972-9de1-6f216c0a020f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:02.593157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d148fec2-dafd-4972-9de1-6f216c0a020f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:02.742660 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-aa5d9e3b-619a-4efc-b1bb-10545fac5629 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:02.762928 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-aa5d9e3b-619a-4efc-b1bb-10545fac5629 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.409447 Jun 15 14:46:02.765068 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 200/399] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:02 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:03.142575 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6a04ead5-2b25-44bd-b1e3-642caf15d7a9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:03.143629 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6a04ead5-2b25-44bd-b1e3-642caf15d7a9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:03.155626 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6a04ead5-2b25-44bd-b1e3-642caf15d7a9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:03.156368 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6a04ead5-2b25-44bd-b1e3-642caf15d7a9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:03.160233 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6a04ead5-2b25-44bd-b1e3-642caf15d7a9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:03.161266 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6a04ead5-2b25-44bd-b1e3-642caf15d7a9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:03.264191 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d148fec2-dafd-4972-9de1-6f216c0a020f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:03.276513 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d148fec2-dafd-4972-9de1-6f216c0a020f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:03.280713 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d148fec2-dafd-4972-9de1-6f216c0a020f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:03.284227 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-d148fec2-dafd-4972-9de1-6f216c0a020f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.714375 Jun 15 14:46:03.286104 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 200/400] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:02 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:46:03.418196 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6a04ead5-2b25-44bd-b1e3-642caf15d7a9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:03.427203 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-6a04ead5-2b25-44bd-b1e3-642caf15d7a9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1725 microversion: 2.1 time: 0.289262 Jun 15 14:46:03.428669 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 201/401] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:03 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1725 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:03.781066 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-32085aa4-eb5b-41b3-9db3-d71668c9b3ac tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:03.782383 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-32085aa4-eb5b-41b3-9db3-d71668c9b3ac tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:03.795864 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-32085aa4-eb5b-41b3-9db3-d71668c9b3ac tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:03.796335 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-32085aa4-eb5b-41b3-9db3-d71668c9b3ac tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:03.797134 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-32085aa4-eb5b-41b3-9db3-d71668c9b3ac tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:03.797582 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-32085aa4-eb5b-41b3-9db3-d71668c9b3ac tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:04.309691 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-d69776e9-b57b-4157-a8bd-0d08df2b7593 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:04.310506 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-d69776e9-b57b-4157-a8bd-0d08df2b7593 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:04.319724 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d69776e9-b57b-4157-a8bd-0d08df2b7593 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:04.325119 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d69776e9-b57b-4157-a8bd-0d08df2b7593 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:04.326162 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d69776e9-b57b-4157-a8bd-0d08df2b7593 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:04.330150 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d69776e9-b57b-4157-a8bd-0d08df2b7593 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:04.392373 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-32085aa4-eb5b-41b3-9db3-d71668c9b3ac tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:04.405599 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-32085aa4-eb5b-41b3-9db3-d71668c9b3ac tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1500 microversion: 2.1 time: 0.628316 Jun 15 14:46:04.427705 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 201/402] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:03 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1500 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:04.435069 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3d1001c5-0702-42ce-9859-a9443e6e1049 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5dac6e8-caeb-4c8f-b6cb-9dca6de6a86e"}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:46:04.436511 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-3d1001c5-0702-42ce-9859-a9443e6e1049 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:04.457093 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3d1001c5-0702-42ce-9859-a9443e6e1049 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:04.457622 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3d1001c5-0702-42ce-9859-a9443e6e1049 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:04.458650 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3d1001c5-0702-42ce-9859-a9443e6e1049 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:04.459270 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3d1001c5-0702-42ce-9859-a9443e6e1049 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:04.500624 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-3d1001c5-0702-42ce-9859-a9443e6e1049 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] HTTP exception thrown: Cannot 'attach_volume' instance 24657b06-5ef6-429a-bce1-db0da36fea71 while it is in vm_state rescued Jun 15 14:46:04.505157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3d1001c5-0702-42ce-9859-a9443e6e1049 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Request method failure captured: Jun 15 14:46:04.505157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: POST /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71/os-volume_attachments HTTP/1.1 Jun 15 14:46:04.505157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:46:04.505157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:46:04.505157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:46:04.505157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 74 Jun 15 14:46:04.505157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:46:04.505157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:46:04.505157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:46:04.505157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:46:04.505157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfAJ8wPnkqs_k4Bo8GSWGVuB1Ap-R1u4L7mH2U3HEuvWVNvlRBO_qyAD7QzOZMMEzF_zcaK0X4c1eXso_54pW74XDCCkghDRm0zR7H0M-gVJaO4FWuw9AQkWNKuoAF0zQpil6wRuiB3fOyyvDJwL5UyfZxFCESuQo14vuw2L05AA968 Jun 15 14:46:04.505157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:46:04.505157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:46:04.505157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:46:04.505157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:46:04.505157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:46:04.505157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:46:04.505157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 26d36b3b04f046d3bee421c5987b965b Jun 15 14:46:04.505157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1197112882 Jun 15 14:46:04.505157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:46:04.505157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:46:04.506774 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/26d36b3b04f046d3bee421c5987b965b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_26d36b3b04f046d3bee421c5987b965b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/26d36b3b04f046d3bee421c5987b965b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/26d36b3b04f046d3bee421c5987b965b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:46:04.506774 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1197112882 Jun 15 14:46:04.506774 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 26d36b3b04f046d3bee421c5987b965b Jun 15 14:46:04.506774 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1197112882 Jun 15 14:46:04.506774 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-ServerRescueNegativeTestJSON-1197112882-project Jun 15 14:46:04.506774 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:46:04.506774 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:46:04.506774 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: ed7372fed3e14f3e98ca25d22a7c7a7e Jun 15 14:46:04.506774 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1197112882-project Jun 15 14:46:04.506774 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Jun 15 14:46:04.506774 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {"volumeAttachment": {"volumeId": "b5dac6e8-caeb-4c8f-b6cb-9dca6de6a86e"}} Jun 15 14:46:04.506774 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:46:04.507643 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Cannot 'attach_volume' instance 24657b06-5ef6-429a-bce1-db0da36fea71 while it is in vm_state rescued Jun 15 14:46:04.507643 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'server_id': '24657b06-5ef6-429a-bce1-db0da36fea71', 'body': {'volumeAttachment': {'volumeId': 'b5dac6e8-caeb-4c8f-b6cb-9dca6de6a86e'}}} Jun 15 14:46:04.507643 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:46:04.507643 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:46:04.507643 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 14:46:04.507643 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 14:46:04.507643 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 14:46:04.507643 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 14:46:04.507643 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 15 14:46:04.507643 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 15 14:46:04.507643 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 24657b06-5ef6-429a-bce1-db0da36fea71 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 15 14:46:04.507643 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:46:04.507643 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:46:04.507643 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:46:04.507643 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:46:04.507643 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:46:04.507643 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:46:04.507643 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:46:04.507643 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:46:04.512604 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:46:04.512604 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:46:04.512604 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 14:46:04.512604 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:46:04.512604 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 14:46:04.512604 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:46:04.512604 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 14:46:04.512604 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:46:04.512604 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 15 14:46:04.512604 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 15 14:46:04.512604 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 15 14:46:04.512604 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 15 14:46:04.512604 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 24657b06-5ef6-429a-bce1-db0da36fea71 while it is in vm_state rescued Jun 15 14:46:04.512604 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:46:04.512604 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:46:04.512604 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:46:04.512604 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:46:04.512604 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:46:04.512604 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:46:04.516890 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:46:04.516890 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:46:04.516890 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 24657b06-5ef6-429a-bce1-db0da36fea71 while it is in vm_state rescued Jun 15 14:46:04.516890 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:46:04.531059 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3d1001c5-0702-42ce-9859-a9443e6e1049 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Returning 409 to user: Cannot 'attach_volume' instance 24657b06-5ef6-429a-bce1-db0da36fea71 while it is in vm_state rescued {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:46:04.532268 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-3d1001c5-0702-42ce-9859-a9443e6e1049 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "POST /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.103240 Jun 15 14:46:04.533075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 202/403] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 14:46:04 2022] POST /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71/os-volume_attachments => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 15 14:46:04.538834 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-2b9fa950-233b-4428-8741-702d09ac351d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:04.548018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-2b9fa950-233b-4428-8741-702d09ac351d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:04.555074 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2b9fa950-233b-4428-8741-702d09ac351d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:04.556361 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2b9fa950-233b-4428-8741-702d09ac351d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:04.557850 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2b9fa950-233b-4428-8741-702d09ac351d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:04.565685 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2b9fa950-233b-4428-8741-702d09ac351d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:04.647030 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-d69776e9-b57b-4157-a8bd-0d08df2b7593 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:04.670842 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-d69776e9-b57b-4157-a8bd-0d08df2b7593 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:04.674705 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-d69776e9-b57b-4157-a8bd-0d08df2b7593 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:04.678585 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-d69776e9-b57b-4157-a8bd-0d08df2b7593 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.373419 Jun 15 14:46:04.681751 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 202/404] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:04 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:04.697896 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-7be00c63-1c2b-4204-952b-42181771fd45 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:46:04.703295 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-7be00c63-1c2b-4204-952b-42181771fd45 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:04.719277 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7be00c63-1c2b-4204-952b-42181771fd45 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:04.723660 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7be00c63-1c2b-4204-952b-42181771fd45 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:04.724793 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7be00c63-1c2b-4204-952b-42181771fd45 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:04.738346 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7be00c63-1c2b-4204-952b-42181771fd45 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:04.878454 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-7be00c63-1c2b-4204-952b-42181771fd45 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "POST /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71/action" status: 202 len: 0 microversion: 2.1 time: 0.193966 Jun 15 14:46:04.879346 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 203/405] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 14:46:04 2022] POST /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:46:04.903396 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-be4b6cc6-0593-4abc-904e-1c42d2997d6b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:04.904655 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-be4b6cc6-0593-4abc-904e-1c42d2997d6b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:04.912719 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-be4b6cc6-0593-4abc-904e-1c42d2997d6b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:04.913488 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-be4b6cc6-0593-4abc-904e-1c42d2997d6b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:04.914834 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-be4b6cc6-0593-4abc-904e-1c42d2997d6b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:04.915496 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-be4b6cc6-0593-4abc-904e-1c42d2997d6b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:05.217628 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-be4b6cc6-0593-4abc-904e-1c42d2997d6b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:05.225525 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-be4b6cc6-0593-4abc-904e-1c42d2997d6b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1508 microversion: 2.1 time: 0.333747 Jun 15 14:46:05.228774 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 204/406] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:04 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1508 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:05.441621 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-2b9fa950-233b-4428-8741-702d09ac351d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:05.454617 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-2b9fa950-233b-4428-8741-702d09ac351d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1725 microversion: 2.1 time: 0.920194 Jun 15 14:46:05.455216 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 203/407] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:04 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1725 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:05.699236 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-9058968f-0a5c-4d26-9717-d0018ad854af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:05.699848 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-9058968f-0a5c-4d26-9717-d0018ad854af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:05.713120 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9058968f-0a5c-4d26-9717-d0018ad854af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:05.714238 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9058968f-0a5c-4d26-9717-d0018ad854af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:05.717613 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9058968f-0a5c-4d26-9717-d0018ad854af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:05.718863 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9058968f-0a5c-4d26-9717-d0018ad854af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:06.116349 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9058968f-0a5c-4d26-9717-d0018ad854af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:06.130414 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9058968f-0a5c-4d26-9717-d0018ad854af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:06.132396 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9058968f-0a5c-4d26-9717-d0018ad854af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:06.138940 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-9058968f-0a5c-4d26-9717-d0018ad854af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.443664 Jun 15 14:46:06.140169 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 205/408] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:05 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:06.247795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-d96b5708-877b-4c83-a983-f077c2ba46b8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:06.249566 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-d96b5708-877b-4c83-a983-f077c2ba46b8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:06.265726 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d96b5708-877b-4c83-a983-f077c2ba46b8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:06.266495 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d96b5708-877b-4c83-a983-f077c2ba46b8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:06.268470 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d96b5708-877b-4c83-a983-f077c2ba46b8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:06.269409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d96b5708-877b-4c83-a983-f077c2ba46b8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:06.473153 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-9b4b225f-302a-46f1-8d91-fdfebb0d525d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:06.473820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-9b4b225f-302a-46f1-8d91-fdfebb0d525d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:06.498799 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9b4b225f-302a-46f1-8d91-fdfebb0d525d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:06.499015 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9b4b225f-302a-46f1-8d91-fdfebb0d525d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:06.499710 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9b4b225f-302a-46f1-8d91-fdfebb0d525d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:06.500404 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9b4b225f-302a-46f1-8d91-fdfebb0d525d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:06.598767 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d96b5708-877b-4c83-a983-f077c2ba46b8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:06.615907 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-d96b5708-877b-4c83-a983-f077c2ba46b8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1508 microversion: 2.1 time: 0.373888 Jun 15 14:46:06.619761 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 204/409] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:06 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1508 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:06.815324 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9b4b225f-302a-46f1-8d91-fdfebb0d525d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:06.825896 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-9b4b225f-302a-46f1-8d91-fdfebb0d525d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1725 microversion: 2.1 time: 0.357410 Jun 15 14:46:06.826476 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 206/410] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:06 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1725 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:07.162381 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-63bb3898-b2fa-4843-9066-02bfb79a0e0f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:07.163018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-63bb3898-b2fa-4843-9066-02bfb79a0e0f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:07.170133 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-63bb3898-b2fa-4843-9066-02bfb79a0e0f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:07.177087 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-63bb3898-b2fa-4843-9066-02bfb79a0e0f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:07.177087 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-63bb3898-b2fa-4843-9066-02bfb79a0e0f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:07.177559 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-63bb3898-b2fa-4843-9066-02bfb79a0e0f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:07.534134 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-63bb3898-b2fa-4843-9066-02bfb79a0e0f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:07.550228 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-63bb3898-b2fa-4843-9066-02bfb79a0e0f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:07.559025 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-63bb3898-b2fa-4843-9066-02bfb79a0e0f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:07.565095 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-63bb3898-b2fa-4843-9066-02bfb79a0e0f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.409580 Jun 15 14:46:07.585352 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 205/411] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:07 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:07.639550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-414cab70-93c7-4dca-be22-9d5b56469cfe tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:07.650113 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-414cab70-93c7-4dca-be22-9d5b56469cfe tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:07.656980 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-414cab70-93c7-4dca-be22-9d5b56469cfe tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:07.658088 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-414cab70-93c7-4dca-be22-9d5b56469cfe tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:07.659168 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-414cab70-93c7-4dca-be22-9d5b56469cfe tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:07.659930 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-414cab70-93c7-4dca-be22-9d5b56469cfe tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:07.844821 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-104b55e2-123d-4871-8e0d-78031a7f3f9c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:07.847253 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-104b55e2-123d-4871-8e0d-78031a7f3f9c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:07.861107 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-104b55e2-123d-4871-8e0d-78031a7f3f9c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:07.865606 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-104b55e2-123d-4871-8e0d-78031a7f3f9c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:07.869462 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-104b55e2-123d-4871-8e0d-78031a7f3f9c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:07.871714 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-104b55e2-123d-4871-8e0d-78031a7f3f9c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:08.278349 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-104b55e2-123d-4871-8e0d-78031a7f3f9c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:08.293411 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-104b55e2-123d-4871-8e0d-78031a7f3f9c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1725 microversion: 2.1 time: 0.453477 Jun 15 14:46:08.303760 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 206/412] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:07 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1725 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:08.590661 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-414cab70-93c7-4dca-be22-9d5b56469cfe tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:08.605380 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-414cab70-93c7-4dca-be22-9d5b56469cfe tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1508 microversion: 2.1 time: 0.972889 Jun 15 14:46:08.606576 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 207/413] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:07 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1508 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:08.621814 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-4c0ba333-bcad-4a68-84b7-5bdffad975f2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:08.622749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-4c0ba333-bcad-4a68-84b7-5bdffad975f2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:08.667650 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4c0ba333-bcad-4a68-84b7-5bdffad975f2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:08.668964 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4c0ba333-bcad-4a68-84b7-5bdffad975f2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:08.670171 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4c0ba333-bcad-4a68-84b7-5bdffad975f2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:08.671600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4c0ba333-bcad-4a68-84b7-5bdffad975f2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:08.788132 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-4f34fb31-1adf-42a0-8d64-d0ca8d0e289c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Action: 'create', calling method: .version_select at 0x7f8f2009da60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1261933231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIt7mw5ucio9JY0DohxgOa1Waw8Oj+9XZyqCNbh+/WMTrVsDBUGYyD8azFL4Eyo6Z/J2WRthUrpDzJtoLts2f548dLPZFLPNMA8s7SbAsRA/1dRzaJR3gak0e4USLloj9w=="}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:46:08.809293 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-4f34fb31-1adf-42a0-8d64-d0ca8d0e289c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Getting quotas for project 2350f7b62a7d4d8199faf8b18b2ca8dc. Resources: {'key_pairs'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:46:08.816404 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-4f34fb31-1adf-42a0-8d64-d0ca8d0e289c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Getting quotas for user 67d64cad336c44d28c9cf31fc9896854 and project 2350f7b62a7d4d8199faf8b18b2ca8dc. Resources: {'key_pairs'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:46:08.860372 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-4f34fb31-1adf-42a0-8d64-d0ca8d0e289c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.555106 Jun 15 14:46:08.861312 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 207/414] 10.222.0.57 () {60 vars in 1158 bytes} [Wed Jun 15 14:46:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:46:09.222154 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-4c0ba333-bcad-4a68-84b7-5bdffad975f2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:09.242450 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-4c0ba333-bcad-4a68-84b7-5bdffad975f2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:09.248192 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-4c0ba333-bcad-4a68-84b7-5bdffad975f2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:09.250081 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-4c0ba333-bcad-4a68-84b7-5bdffad975f2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.641680 Jun 15 14:46:09.252726 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 208/415] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:08 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:09.311814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c32ea5a0-de98-426e-8c78-28b153a78006 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:09.312435 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c32ea5a0-de98-426e-8c78-28b153a78006 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:09.324193 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c32ea5a0-de98-426e-8c78-28b153a78006 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:09.324628 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c32ea5a0-de98-426e-8c78-28b153a78006 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:09.325399 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c32ea5a0-de98-426e-8c78-28b153a78006 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:09.325869 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c32ea5a0-de98-426e-8c78-28b153a78006 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:09.603513 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c32ea5a0-de98-426e-8c78-28b153a78006 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:09.618640 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-c32ea5a0-de98-426e-8c78-28b153a78006 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1725 microversion: 2.1 time: 0.309952 Jun 15 14:46:09.620100 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 208/416] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:09 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1725 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:09.629041 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6e45680c-60e1-4c6b-8634-733e182259c4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:09.630473 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6e45680c-60e1-4c6b-8634-733e182259c4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:09.640891 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6e45680c-60e1-4c6b-8634-733e182259c4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:09.641544 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6e45680c-60e1-4c6b-8634-733e182259c4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:09.643708 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6e45680c-60e1-4c6b-8634-733e182259c4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:09.644630 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6e45680c-60e1-4c6b-8634-733e182259c4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:09.947799 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6e45680c-60e1-4c6b-8634-733e182259c4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:09.955832 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-6e45680c-60e1-4c6b-8634-733e182259c4 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1508 microversion: 2.1 time: 0.335088 Jun 15 14:46:09.956798 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 209/417] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:09 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1508 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:10.270445 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-8edce63b-0901-41db-b9e1-f3667294e335 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:10.271063 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-8edce63b-0901-41db-b9e1-f3667294e335 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:10.289617 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8edce63b-0901-41db-b9e1-f3667294e335 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:10.290673 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8edce63b-0901-41db-b9e1-f3667294e335 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:10.291525 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8edce63b-0901-41db-b9e1-f3667294e335 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:10.291923 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8edce63b-0901-41db-b9e1-f3667294e335 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:10.545782 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-8edce63b-0901-41db-b9e1-f3667294e335 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:10.557773 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-8edce63b-0901-41db-b9e1-f3667294e335 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:10.563538 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-8edce63b-0901-41db-b9e1-f3667294e335 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:10.565045 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-8edce63b-0901-41db-b9e1-f3667294e335 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.298538 Jun 15 14:46:10.567380 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 209/418] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:10 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:10.636419 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a7ac2087-1d91-49b0-898e-0b68d1d87497 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:10.638053 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a7ac2087-1d91-49b0-898e-0b68d1d87497 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:10.646319 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a7ac2087-1d91-49b0-898e-0b68d1d87497 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:10.647560 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a7ac2087-1d91-49b0-898e-0b68d1d87497 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:10.648670 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a7ac2087-1d91-49b0-898e-0b68d1d87497 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:10.649835 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a7ac2087-1d91-49b0-898e-0b68d1d87497 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:10.944659 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a7ac2087-1d91-49b0-898e-0b68d1d87497 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:10.955532 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a7ac2087-1d91-49b0-898e-0b68d1d87497 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1725 microversion: 2.1 time: 0.323374 Jun 15 14:46:10.956440 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 210/419] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:10 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1725 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:10.977128 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e693ae49-6b29-4e39-b8f6-6690516fb937 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:10.981412 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-e693ae49-6b29-4e39-b8f6-6690516fb937 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:10.993643 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e693ae49-6b29-4e39-b8f6-6690516fb937 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:10.994222 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e693ae49-6b29-4e39-b8f6-6690516fb937 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:10.995349 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e693ae49-6b29-4e39-b8f6-6690516fb937 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:10.995802 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e693ae49-6b29-4e39-b8f6-6690516fb937 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:11.218491 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e693ae49-6b29-4e39-b8f6-6690516fb937 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:11.227910 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-e693ae49-6b29-4e39-b8f6-6690516fb937 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1514 microversion: 2.1 time: 0.255279 Jun 15 14:46:11.241390 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 210/420] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:10 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1514 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:11.585313 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-8b07e036-5909-457a-8a57-c0893f500bf9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:11.585958 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-8b07e036-5909-457a-8a57-c0893f500bf9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:11.601174 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8b07e036-5909-457a-8a57-c0893f500bf9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:11.601637 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8b07e036-5909-457a-8a57-c0893f500bf9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:11.603005 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8b07e036-5909-457a-8a57-c0893f500bf9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:11.603447 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8b07e036-5909-457a-8a57-c0893f500bf9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:11.930805 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-8b07e036-5909-457a-8a57-c0893f500bf9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:11.943104 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-8b07e036-5909-457a-8a57-c0893f500bf9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:11.960243 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-8b07e036-5909-457a-8a57-c0893f500bf9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:11.967570 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-8b07e036-5909-457a-8a57-c0893f500bf9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1744 microversion: 2.20 time: 0.384977 Jun 15 14:46:11.970028 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 211/421] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:11 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1744 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:11.972216 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-565ab00b-6546-4917-8e60-139360d63edc tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:11.973645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-565ab00b-6546-4917-8e60-139360d63edc tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:11.985551 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-565ab00b-6546-4917-8e60-139360d63edc tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:11.986258 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-565ab00b-6546-4917-8e60-139360d63edc tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:11.987189 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-565ab00b-6546-4917-8e60-139360d63edc tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:11.987887 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-565ab00b-6546-4917-8e60-139360d63edc tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:12.304935 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-565ab00b-6546-4917-8e60-139360d63edc tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:12.322824 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-565ab00b-6546-4917-8e60-139360d63edc tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1725 microversion: 2.1 time: 0.354180 Jun 15 14:46:12.324033 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 211/422] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:11 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1725 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:12.944510 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-f4234860-c85e-4c3d-b17f-7b2899343280 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Action: 'create', calling method: .version_select at 0x7f8f201bb550>, body: {"keypair": {"name": "tempest-keypair-946754658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJw9Nrrmgxm1lwAyJrDYY9M0cBh/rACmT6qp690pwPOlxULx8/jTVXFCmIBK/oSllVlyqYJgBA3PAUNscu0f3ynOpd9l0O7fLebGiVeyWPyyIY4PIuHfIJLHXyGU2El0Q=="}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:46:12.969393 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-f4234860-c85e-4c3d-b17f-7b2899343280 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Getting quotas for project 26d36b3b04f046d3bee421c5987b965b. Resources: {'key_pairs'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:46:12.982033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-f4234860-c85e-4c3d-b17f-7b2899343280 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Getting quotas for user ed7372fed3e14f3e98ca25d22a7c7a7e and project 26d36b3b04f046d3bee421c5987b965b. Resources: {'key_pairs'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:46:12.987687 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-79552ba1-b8e8-4556-9f58-15b81bfdfaff tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:12.988308 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-79552ba1-b8e8-4556-9f58-15b81bfdfaff tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:12.996943 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-79552ba1-b8e8-4556-9f58-15b81bfdfaff tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:12.997294 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-79552ba1-b8e8-4556-9f58-15b81bfdfaff tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:13.023426 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-79552ba1-b8e8-4556-9f58-15b81bfdfaff tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:13.023894 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-79552ba1-b8e8-4556-9f58-15b81bfdfaff tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:13.041087 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=100 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:13.068487 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-f4234860-c85e-4c3d-b17f-7b2899343280 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.128286 Jun 15 14:46:13.069150 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 212/423] 10.222.0.57 () {60 vars in 1158 bytes} [Wed Jun 15 14:46:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:46:13.342772 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-50b3e2b1-a6e6-465c-9b5b-a7b6ef266ce2 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:13.343765 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-50b3e2b1-a6e6-465c-9b5b-a7b6ef266ce2 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:13.360993 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-50b3e2b1-a6e6-465c-9b5b-a7b6ef266ce2 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:13.361941 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-50b3e2b1-a6e6-465c-9b5b-a7b6ef266ce2 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:13.363233 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-50b3e2b1-a6e6-465c-9b5b-a7b6ef266ce2 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:13.364092 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-50b3e2b1-a6e6-465c-9b5b-a7b6ef266ce2 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:13.560156 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-79552ba1-b8e8-4556-9f58-15b81bfdfaff tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:13.570479 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-79552ba1-b8e8-4556-9f58-15b81bfdfaff tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:13.572775 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-79552ba1-b8e8-4556-9f58-15b81bfdfaff tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:13.590153 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-79552ba1-b8e8-4556-9f58-15b81bfdfaff tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1744 microversion: 2.20 time: 0.605707 Jun 15 14:46:13.614132 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 212/424] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:12 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1744 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:46:13.691777 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-50b3e2b1-a6e6-465c-9b5b-a7b6ef266ce2 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:13.702118 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-50b3e2b1-a6e6-465c-9b5b-a7b6ef266ce2 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1725 microversion: 2.1 time: 0.365956 Jun 15 14:46:13.709091 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 213/425] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:13 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1725 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:14.609978 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-80d5d8d2-5ae9-47d9-91ae-632bbf817d0a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:14.611182 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-80d5d8d2-5ae9-47d9-91ae-632bbf817d0a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:14.633512 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-80d5d8d2-5ae9-47d9-91ae-632bbf817d0a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:14.639734 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-80d5d8d2-5ae9-47d9-91ae-632bbf817d0a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:14.651361 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-80d5d8d2-5ae9-47d9-91ae-632bbf817d0a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:14.651881 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-80d5d8d2-5ae9-47d9-91ae-632bbf817d0a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:14.726908 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a56fff18-a28b-4d99-86b9-5a5c37457540 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:14.728396 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a56fff18-a28b-4d99-86b9-5a5c37457540 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:14.738886 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a56fff18-a28b-4d99-86b9-5a5c37457540 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:14.739938 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a56fff18-a28b-4d99-86b9-5a5c37457540 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:14.743982 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a56fff18-a28b-4d99-86b9-5a5c37457540 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:14.745336 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a56fff18-a28b-4d99-86b9-5a5c37457540 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:14.937300 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-80d5d8d2-5ae9-47d9-91ae-632bbf817d0a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:14.946906 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-80d5d8d2-5ae9-47d9-91ae-632bbf817d0a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:14.949143 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-80d5d8d2-5ae9-47d9-91ae-632bbf817d0a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:14.950672 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-80d5d8d2-5ae9-47d9-91ae-632bbf817d0a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1739 microversion: 2.20 time: 0.345318 Jun 15 14:46:14.951396 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 213/426] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:14 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1739 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:15.099100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a56fff18-a28b-4d99-86b9-5a5c37457540 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:15.116097 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:15.124389 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a56fff18-a28b-4d99-86b9-5a5c37457540 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1725 microversion: 2.1 time: 0.401496 Jun 15 14:46:15.124988 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 214/427] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:14 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1725 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:15.136327 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-30e7085e-85d6-4f4b-b008-823560ab398e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Action: 'create', calling method: .version_select at 0x7f8f13fa6940>, body: {"keypair": {"name": "tempest-TestShelveInstance-669145631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvWxypWbQjkpXNSoAuJdNDZTurnoGNpsg9Kh+lenYQnVm6y+hmCAAlGYSpUTRNpn0o70zjj0upz6TZCV4kfAHeR8D4QRS8Zu75vpEYgbCK8tRL+qlpXn0A+e+vRZl6qcg=="}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:46:15.172934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-30e7085e-85d6-4f4b-b008-823560ab398e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Getting quotas for project 79a3fa88f5ea4fa2940733b09cbc835a. Resources: {'key_pairs'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:46:15.182773 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-30e7085e-85d6-4f4b-b008-823560ab398e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Getting quotas for user af5c10fc72dc44e59030216239fc678d and project 79a3fa88f5ea4fa2940733b09cbc835a. Resources: {'key_pairs'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:46:15.249639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-30e7085e-85d6-4f4b-b008-823560ab398e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.280244 Jun 15 14:46:15.253712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 214/428] 10.222.0.57 () {60 vars in 1158 bytes} [Wed Jun 15 14:46:14 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:46:15.974971 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e6c36c95-8253-4f4b-838e-ba4a2688367d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:15.977165 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-238bb6b2-3a5b-40ae-b267-f20fd50bd7eb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-968450273", "imageRef": "e18802bf-9dac-462c-88ba-5cce79043279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81a884fa-a70c-46e6-b401-b5d5d80eaa1f"}], "security_groups": [{"name": "tempest-securitygroup--1998932815"}], "key_name": "tempest-keypair-946754658", "user_data": "}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:46:15.980907 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-e6c36c95-8253-4f4b-838e-ba4a2688367d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:15.990126 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=1 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:15.996593 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e6c36c95-8253-4f4b-838e-ba4a2688367d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:15.997167 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e6c36c95-8253-4f4b-838e-ba4a2688367d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:15.998939 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e6c36c95-8253-4f4b-838e-ba4a2688367d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:15.999478 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e6c36c95-8253-4f4b-838e-ba4a2688367d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:16.258771 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e6c36c95-8253-4f4b-838e-ba4a2688367d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:16.272575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e6c36c95-8253-4f4b-838e-ba4a2688367d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:16.274541 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e6c36c95-8253-4f4b-838e-ba4a2688367d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:16.314426 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-e6c36c95-8253-4f4b-838e-ba4a2688367d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1739 microversion: 2.20 time: 0.344954 Jun 15 14:46:16.315381 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 215/429] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:15 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1739 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:16.323677 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f15a2c7f-0121-4ba4-b795-89599ddc357b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:16.324645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f15a2c7f-0121-4ba4-b795-89599ddc357b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:16.335244 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f15a2c7f-0121-4ba4-b795-89599ddc357b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:16.335962 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f15a2c7f-0121-4ba4-b795-89599ddc357b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:16.337199 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f15a2c7f-0121-4ba4-b795-89599ddc357b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:16.338024 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f15a2c7f-0121-4ba4-b795-89599ddc357b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:16.561735 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f15a2c7f-0121-4ba4-b795-89599ddc357b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:16.571749 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f15a2c7f-0121-4ba4-b795-89599ddc357b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1725 microversion: 2.1 time: 0.255104 Jun 15 14:46:16.572763 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 216/430] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:16 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1725 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:17.346022 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-d24664b1-d621-47c1-8878-f4d455f18ea6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:17.347531 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-d24664b1-d621-47c1-8878-f4d455f18ea6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:17.363176 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d24664b1-d621-47c1-8878-f4d455f18ea6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:17.366311 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d24664b1-d621-47c1-8878-f4d455f18ea6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:17.368509 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d24664b1-d621-47c1-8878-f4d455f18ea6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:17.370191 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d24664b1-d621-47c1-8878-f4d455f18ea6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:17.663364 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d24664b1-d621-47c1-8878-f4d455f18ea6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:17.677978 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d24664b1-d621-47c1-8878-f4d455f18ea6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:17.679491 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d24664b1-d621-47c1-8878-f4d455f18ea6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:17.681410 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-d24664b1-d621-47c1-8878-f4d455f18ea6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1739 microversion: 2.20 time: 0.339985 Jun 15 14:46:17.682175 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 217/431] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:17 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1739 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:17.703087 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-22fc673a-e8da-45e7-a937-2839b24842c1 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:17.704024 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-22fc673a-e8da-45e7-a937-2839b24842c1 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:17.717654 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-22fc673a-e8da-45e7-a937-2839b24842c1 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:17.718183 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-22fc673a-e8da-45e7-a937-2839b24842c1 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:17.719482 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-22fc673a-e8da-45e7-a937-2839b24842c1 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:17.719940 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-22fc673a-e8da-45e7-a937-2839b24842c1 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:17.957477 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-22fc673a-e8da-45e7-a937-2839b24842c1 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:17.973927 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-22fc673a-e8da-45e7-a937-2839b24842c1 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1725 microversion: 2.1 time: 0.273307 Jun 15 14:46:17.974644 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 218/432] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:17 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1725 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:17.980221 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-273507f8-da9d-44d2-8dc8-08b4cf36de72 req-a6270efd-32b0-4f0a-9562-f5858d792914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123ea48b-cb21-429c-85c6-0ae71d51c1c0", "name": "network-vif-plugged", "status": "completed", "tag": "3b30c106-589d-4777-be4f-8c3b882d514e"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:46:17.989918 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-273507f8-da9d-44d2-8dc8-08b4cf36de72 req-a6270efd-32b0-4f0a-9562-f5858d792914 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:17.990660 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-273507f8-da9d-44d2-8dc8-08b4cf36de72 req-a6270efd-32b0-4f0a-9562-f5858d792914 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:18.007096 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-273507f8-da9d-44d2-8dc8-08b4cf36de72 req-a6270efd-32b0-4f0a-9562-f5858d792914 service nova] Creating event network-vif-plugged:3b30c106-589d-4777-be4f-8c3b882d514e for instance 123ea48b-cb21-429c-85c6-0ae71d51c1c0 on hv-cinder-84327 Jun 15 14:46:18.013397 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-273507f8-da9d-44d2-8dc8-08b4cf36de72 req-a6270efd-32b0-4f0a-9562-f5858d792914 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037355 Jun 15 14:46:18.014180 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 219/433] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:46:18.701144 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-5604a877-70d7-4b86-b5af-f612f890ec25 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:18.701984 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-5604a877-70d7-4b86-b5af-f612f890ec25 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:18.709709 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5604a877-70d7-4b86-b5af-f612f890ec25 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:18.710877 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5604a877-70d7-4b86-b5af-f612f890ec25 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:18.712446 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5604a877-70d7-4b86-b5af-f612f890ec25 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:18.713575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5604a877-70d7-4b86-b5af-f612f890ec25 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:18.890191 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-5604a877-70d7-4b86-b5af-f612f890ec25 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:18.934992 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-5604a877-70d7-4b86-b5af-f612f890ec25 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:18.939398 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-5604a877-70d7-4b86-b5af-f612f890ec25 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:18.941275 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-5604a877-70d7-4b86-b5af-f612f890ec25 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1739 microversion: 2.20 time: 0.245014 Jun 15 14:46:18.950852 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 220/434] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:18 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:18.999096 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-ac5ffd37-e9d5-4bf6-bef8-92acd785a859 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:18.999987 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-ac5ffd37-e9d5-4bf6-bef8-92acd785a859 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:19.015196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ac5ffd37-e9d5-4bf6-bef8-92acd785a859 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:19.015753 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ac5ffd37-e9d5-4bf6-bef8-92acd785a859 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:19.016549 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ac5ffd37-e9d5-4bf6-bef8-92acd785a859 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:19.017069 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ac5ffd37-e9d5-4bf6-bef8-92acd785a859 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:19.213725 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-ac5ffd37-e9d5-4bf6-bef8-92acd785a859 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:19.222696 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-ac5ffd37-e9d5-4bf6-bef8-92acd785a859 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1725 microversion: 2.1 time: 0.227948 Jun 15 14:46:19.223594 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 221/435] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:18 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:19.960767 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-1ae72073-cd01-4975-9ece-633b16e5ff6e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:19.961421 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-1ae72073-cd01-4975-9ece-633b16e5ff6e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:19.969034 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1ae72073-cd01-4975-9ece-633b16e5ff6e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:19.970319 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1ae72073-cd01-4975-9ece-633b16e5ff6e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:19.971656 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1ae72073-cd01-4975-9ece-633b16e5ff6e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:19.972234 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1ae72073-cd01-4975-9ece-633b16e5ff6e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:20.132683 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-1ae72073-cd01-4975-9ece-633b16e5ff6e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:20.142876 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-1ae72073-cd01-4975-9ece-633b16e5ff6e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:20.144524 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-1ae72073-cd01-4975-9ece-633b16e5ff6e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:20.145733 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-1ae72073-cd01-4975-9ece-633b16e5ff6e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1739 microversion: 2.20 time: 0.188920 Jun 15 14:46:20.147124 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 222/436] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:19 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:46:20.239676 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-90aa2662-e234-4624-825b-f77ef38535db tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:20.240295 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-90aa2662-e234-4624-825b-f77ef38535db tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:20.248139 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-90aa2662-e234-4624-825b-f77ef38535db tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:20.248980 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-90aa2662-e234-4624-825b-f77ef38535db tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:20.249526 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-90aa2662-e234-4624-825b-f77ef38535db tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:20.250126 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-90aa2662-e234-4624-825b-f77ef38535db tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:20.440067 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-90aa2662-e234-4624-825b-f77ef38535db tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:20.453472 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-90aa2662-e234-4624-825b-f77ef38535db tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1725 microversion: 2.1 time: 0.217787 Jun 15 14:46:20.466818 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 223/437] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:20 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1725 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:21.167948 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-705650c7-ec22-40d1-8f84-0ddab7f58ed1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:21.169399 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-705650c7-ec22-40d1-8f84-0ddab7f58ed1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:21.178000 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-705650c7-ec22-40d1-8f84-0ddab7f58ed1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:21.178649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-705650c7-ec22-40d1-8f84-0ddab7f58ed1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:21.179679 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-705650c7-ec22-40d1-8f84-0ddab7f58ed1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:21.182335 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-705650c7-ec22-40d1-8f84-0ddab7f58ed1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:21.379734 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-705650c7-ec22-40d1-8f84-0ddab7f58ed1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:21.392211 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-705650c7-ec22-40d1-8f84-0ddab7f58ed1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:21.394793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-705650c7-ec22-40d1-8f84-0ddab7f58ed1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:21.396182 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-705650c7-ec22-40d1-8f84-0ddab7f58ed1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1739 microversion: 2.20 time: 0.233043 Jun 15 14:46:21.397284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 224/438] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:21 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:46:21.475129 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e2592ca2-d0b6-4a6b-bf10-06006c78b02e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:21.475810 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-e2592ca2-d0b6-4a6b-bf10-06006c78b02e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:21.484196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e2592ca2-d0b6-4a6b-bf10-06006c78b02e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:21.484196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e2592ca2-d0b6-4a6b-bf10-06006c78b02e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:21.484196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e2592ca2-d0b6-4a6b-bf10-06006c78b02e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:21.484781 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e2592ca2-d0b6-4a6b-bf10-06006c78b02e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:21.684790 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e2592ca2-d0b6-4a6b-bf10-06006c78b02e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:21.698395 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-e2592ca2-d0b6-4a6b-bf10-06006c78b02e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1725 microversion: 2.1 time: 0.226967 Jun 15 14:46:21.705920 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 225/439] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:21 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:22.417187 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-b2605b94-ee26-426f-b2e1-30d98a865610 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:22.417187 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-b2605b94-ee26-426f-b2e1-30d98a865610 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:22.427063 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b2605b94-ee26-426f-b2e1-30d98a865610 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:22.427716 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b2605b94-ee26-426f-b2e1-30d98a865610 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:22.428625 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b2605b94-ee26-426f-b2e1-30d98a865610 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:22.429157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b2605b94-ee26-426f-b2e1-30d98a865610 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:22.615168 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b2605b94-ee26-426f-b2e1-30d98a865610 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:22.625644 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b2605b94-ee26-426f-b2e1-30d98a865610 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:22.627208 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b2605b94-ee26-426f-b2e1-30d98a865610 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:22.629075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-b2605b94-ee26-426f-b2e1-30d98a865610 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1739 microversion: 2.20 time: 0.217965 Jun 15 14:46:22.640707 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 226/440] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:22 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:46:22.723937 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-2970c870-dca7-4c92-80a5-e8ae5482a737 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:22.724996 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-2970c870-dca7-4c92-80a5-e8ae5482a737 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:22.734713 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2970c870-dca7-4c92-80a5-e8ae5482a737 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:22.735165 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2970c870-dca7-4c92-80a5-e8ae5482a737 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:22.735937 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2970c870-dca7-4c92-80a5-e8ae5482a737 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:22.736524 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2970c870-dca7-4c92-80a5-e8ae5482a737 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:22.937440 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-2970c870-dca7-4c92-80a5-e8ae5482a737 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:22.958980 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-2970c870-dca7-4c92-80a5-e8ae5482a737 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1702 microversion: 2.1 time: 0.241139 Jun 15 14:46:22.964966 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 227/441] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:22 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1702 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:22.977899 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-6fc128e5-bca0-4828-be5f-43ef7f67a0cf tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:46:22.986530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6fc128e5-bca0-4828-be5f-43ef7f67a0cf tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:22.986973 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6fc128e5-bca0-4828-be5f-43ef7f67a0cf tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:23.014318 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=4 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:23.036591 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-6fc128e5-bca0-4828-be5f-43ef7f67a0cf tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Going to try to start instance {{(pid=124219) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 15 14:46:23.109115 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-6fc128e5-bca0-4828-be5f-43ef7f67a0cf tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "POST /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b/action" status: 202 len: 0 microversion: 2.1 time: 0.136488 Jun 15 14:46:23.113441 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 228/442] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 14:46:22 2022] POST /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:46:23.159969 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-62c179fc-ed56-4a90-8044-02a1bafe77f0 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:23.161754 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-62c179fc-ed56-4a90-8044-02a1bafe77f0 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:23.198257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-62c179fc-ed56-4a90-8044-02a1bafe77f0 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:23.198718 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-62c179fc-ed56-4a90-8044-02a1bafe77f0 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:23.199510 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-62c179fc-ed56-4a90-8044-02a1bafe77f0 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:23.200326 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-62c179fc-ed56-4a90-8044-02a1bafe77f0 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:23.250595 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:23.446017 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-62c179fc-ed56-4a90-8044-02a1bafe77f0 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:23.458788 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-62c179fc-ed56-4a90-8044-02a1bafe77f0 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1711 microversion: 2.1 time: 0.342560 Jun 15 14:46:23.460143 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 229/443] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:23 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1711 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:23.648552 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-15f8d9a9-2b09-44d9-abbf-11a9506d5beb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:23.649170 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-15f8d9a9-2b09-44d9-abbf-11a9506d5beb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:23.660531 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-15f8d9a9-2b09-44d9-abbf-11a9506d5beb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:23.660994 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-15f8d9a9-2b09-44d9-abbf-11a9506d5beb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:23.661830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-15f8d9a9-2b09-44d9-abbf-11a9506d5beb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:23.662277 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-15f8d9a9-2b09-44d9-abbf-11a9506d5beb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:23.842534 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-15f8d9a9-2b09-44d9-abbf-11a9506d5beb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:23.853518 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-15f8d9a9-2b09-44d9-abbf-11a9506d5beb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:23.855704 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-15f8d9a9-2b09-44d9-abbf-11a9506d5beb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:23.859917 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-15f8d9a9-2b09-44d9-abbf-11a9506d5beb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1739 microversion: 2.20 time: 0.215825 Jun 15 14:46:23.860819 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 230/444] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:23 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1739 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:46:24.480939 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-47121744-cee7-4030-af68-6f0b89b57ed7 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:24.481700 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-47121744-cee7-4030-af68-6f0b89b57ed7 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:24.488813 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-47121744-cee7-4030-af68-6f0b89b57ed7 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:24.490291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-47121744-cee7-4030-af68-6f0b89b57ed7 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:24.490291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-47121744-cee7-4030-af68-6f0b89b57ed7 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:24.490534 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-47121744-cee7-4030-af68-6f0b89b57ed7 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:24.666379 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-47121744-cee7-4030-af68-6f0b89b57ed7 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:24.675619 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-47121744-cee7-4030-af68-6f0b89b57ed7 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1711 microversion: 2.1 time: 0.199078 Jun 15 14:46:24.676521 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 231/445] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:24 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1711 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:24.879870 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-7586863e-0392-42de-abe5-b24c19c1ff9b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:24.884041 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-7586863e-0392-42de-abe5-b24c19c1ff9b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:24.886823 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:24.895736 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7586863e-0392-42de-abe5-b24c19c1ff9b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:24.896927 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7586863e-0392-42de-abe5-b24c19c1ff9b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:24.898813 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7586863e-0392-42de-abe5-b24c19c1ff9b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:24.901196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7586863e-0392-42de-abe5-b24c19c1ff9b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:25.072564 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-7586863e-0392-42de-abe5-b24c19c1ff9b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:25.080797 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-7586863e-0392-42de-abe5-b24c19c1ff9b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:25.082318 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-7586863e-0392-42de-abe5-b24c19c1ff9b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:25.083493 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-7586863e-0392-42de-abe5-b24c19c1ff9b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1739 microversion: 2.20 time: 0.208150 Jun 15 14:46:25.085713 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 232/446] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:24 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:46:25.692393 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-fd038f8f-dc44-4fc1-8f70-cd321bc357fd tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:25.693061 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-fd038f8f-dc44-4fc1-8f70-cd321bc357fd tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:25.694840 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=8 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:25.702898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fd038f8f-dc44-4fc1-8f70-cd321bc357fd tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:25.703578 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fd038f8f-dc44-4fc1-8f70-cd321bc357fd tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:25.704687 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fd038f8f-dc44-4fc1-8f70-cd321bc357fd tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:25.705292 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fd038f8f-dc44-4fc1-8f70-cd321bc357fd tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:25.876847 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-fd038f8f-dc44-4fc1-8f70-cd321bc357fd tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:25.887039 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-fd038f8f-dc44-4fc1-8f70-cd321bc357fd tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1711 microversion: 2.1 time: 0.198434 Jun 15 14:46:25.887620 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 233/447] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:25 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1711 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:26.019189 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=1 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:26.102503 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-9c528a61-91b8-4084-aed4-fe7a7e179f43 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:26.103680 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-9c528a61-91b8-4084-aed4-fe7a7e179f43 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:26.116005 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9c528a61-91b8-4084-aed4-fe7a7e179f43 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:26.117003 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9c528a61-91b8-4084-aed4-fe7a7e179f43 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:26.118642 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9c528a61-91b8-4084-aed4-fe7a7e179f43 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:26.119198 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9c528a61-91b8-4084-aed4-fe7a7e179f43 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:26.289703 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-9c528a61-91b8-4084-aed4-fe7a7e179f43 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:26.300723 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-9c528a61-91b8-4084-aed4-fe7a7e179f43 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:26.302833 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-9c528a61-91b8-4084-aed4-fe7a7e179f43 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:26.304364 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-9c528a61-91b8-4084-aed4-fe7a7e179f43 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1739 microversion: 2.20 time: 0.206561 Jun 15 14:46:26.305081 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 234/448] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:26 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:26.460313 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.network.neutron [None req-238bb6b2-3a5b-40ae-b267-f20fd50bd7eb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] validate_networks() for [('81a884fa-a70c-46e6-b401-b5d5d80eaa1f', None, None, None, None, None)] {{(pid=124220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:46:26.874283 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-238bb6b2-3a5b-40ae-b267-f20fd50bd7eb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Flavor limits 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:46:26.874714 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-238bb6b2-3a5b-40ae-b267-f20fd50bd7eb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Image limits 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:46:26.875186 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-238bb6b2-3a5b-40ae-b267-f20fd50bd7eb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Flavor pref 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:46:26.875601 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-238bb6b2-3a5b-40ae-b267-f20fd50bd7eb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Image pref 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:46:26.876019 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-238bb6b2-3a5b-40ae-b267-f20fd50bd7eb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:46:26.884984 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-238bb6b2-3a5b-40ae-b267-f20fd50bd7eb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:26.885431 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-238bb6b2-3a5b-40ae-b267-f20fd50bd7eb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:26.886278 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-238bb6b2-3a5b-40ae-b267-f20fd50bd7eb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:26.886714 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-238bb6b2-3a5b-40ae-b267-f20fd50bd7eb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:26.904901 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-be88b026-266a-4caf-a632-681a425c1cc4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:26.906216 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-be88b026-266a-4caf-a632-681a425c1cc4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:26.907489 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-238bb6b2-3a5b-40ae-b267-f20fd50bd7eb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Getting quotas for project 26d36b3b04f046d3bee421c5987b965b. Resources: {'cores', 'instances', 'ram'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:46:26.911679 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-238bb6b2-3a5b-40ae-b267-f20fd50bd7eb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Getting quotas for user ed7372fed3e14f3e98ca25d22a7c7a7e and project 26d36b3b04f046d3bee421c5987b965b. Resources: {'cores', 'instances', 'ram'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:46:26.912958 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-be88b026-266a-4caf-a632-681a425c1cc4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:26.913407 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-be88b026-266a-4caf-a632-681a425c1cc4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:26.914241 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-be88b026-266a-4caf-a632-681a425c1cc4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:26.914673 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-be88b026-266a-4caf-a632-681a425c1cc4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:26.923980 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-238bb6b2-3a5b-40ae-b267-f20fd50bd7eb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Going to run 1 instances... {{(pid=124220) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:46:26.926419 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-238bb6b2-3a5b-40ae-b267-f20fd50bd7eb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e18802bf-9dac-462c-88ba-5cce79043279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:46:26.971915 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR oslo.messaging._drivers.impl_rabbit [None req-238bb6b2-3a5b-40ae-b267-f20fd50bd7eb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [1c947742-53b7-4fcd-8fc8-00369852063f] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 15 14:46:27.056273 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-be88b026-266a-4caf-a632-681a425c1cc4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:27.064196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-be88b026-266a-4caf-a632-681a425c1cc4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1715 microversion: 2.1 time: 0.163184 Jun 15 14:46:27.064759 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 235/449] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:26 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1715 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:27.324344 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e67a2ef0-d741-459d-a737-2617e723b58f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:27.325374 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-e67a2ef0-d741-459d-a737-2617e723b58f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:27.331877 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e67a2ef0-d741-459d-a737-2617e723b58f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:27.332487 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e67a2ef0-d741-459d-a737-2617e723b58f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:27.333363 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e67a2ef0-d741-459d-a737-2617e723b58f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:27.333956 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e67a2ef0-d741-459d-a737-2617e723b58f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:27.484004 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e67a2ef0-d741-459d-a737-2617e723b58f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:27.492567 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e67a2ef0-d741-459d-a737-2617e723b58f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:27.494242 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e67a2ef0-d741-459d-a737-2617e723b58f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:27.495606 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-e67a2ef0-d741-459d-a737-2617e723b58f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1721 microversion: 2.20 time: 0.175770 Jun 15 14:46:27.496186 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 236/450] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:27 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:46:27.981280 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO oslo.messaging._drivers.impl_rabbit [None req-238bb6b2-3a5b-40ae-b267-f20fd50bd7eb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [1c947742-53b7-4fcd-8fc8-00369852063f] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 41182. Jun 15 14:46:27.985409 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-238bb6b2-3a5b-40ae-b267-f20fd50bd7eb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 12.016456 Jun 15 14:46:27.986089 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 215/451] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 14:46:15 2022] POST /compute/v2.1/servers => generated 409 bytes in 12018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:46:27.997250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-312425dd-9ae6-42e2-9cbc-41e41615bed1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:27.997897 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-312425dd-9ae6-42e2-9cbc-41e41615bed1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:28.068096 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-312425dd-9ae6-42e2-9cbc-41e41615bed1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:28.075991 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-312425dd-9ae6-42e2-9cbc-41e41615bed1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1244 microversion: 2.1 time: 0.083883 Jun 15 14:46:28.076912 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 237/452] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:27 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:28.515433 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-938cd710-87bd-4e4c-9ded-98b66747a9f5 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:28.515992 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-938cd710-87bd-4e4c-9ded-98b66747a9f5 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:28.522177 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-938cd710-87bd-4e4c-9ded-98b66747a9f5 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:28.522630 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-938cd710-87bd-4e4c-9ded-98b66747a9f5 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:28.523393 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-938cd710-87bd-4e4c-9ded-98b66747a9f5 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:28.523832 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-938cd710-87bd-4e4c-9ded-98b66747a9f5 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:28.657627 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-938cd710-87bd-4e4c-9ded-98b66747a9f5 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:28.665512 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-938cd710-87bd-4e4c-9ded-98b66747a9f5 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:28.667407 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-938cd710-87bd-4e4c-9ded-98b66747a9f5 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:28.668571 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-938cd710-87bd-4e4c-9ded-98b66747a9f5 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1721 microversion: 2.20 time: 0.157219 Jun 15 14:46:28.669114 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 216/453] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:28 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:29.092558 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-90e58dcb-f2a6-47b7-b07b-a713dddb48a8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:29.093167 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-90e58dcb-f2a6-47b7-b07b-a713dddb48a8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:29.100220 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-90e58dcb-f2a6-47b7-b07b-a713dddb48a8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:29.100668 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-90e58dcb-f2a6-47b7-b07b-a713dddb48a8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:29.101426 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-90e58dcb-f2a6-47b7-b07b-a713dddb48a8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:29.101893 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-90e58dcb-f2a6-47b7-b07b-a713dddb48a8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:29.166125 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-90e58dcb-f2a6-47b7-b07b-a713dddb48a8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:29.176391 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-90e58dcb-f2a6-47b7-b07b-a713dddb48a8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1248 microversion: 2.1 time: 0.087777 Jun 15 14:46:29.177274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 238/454] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:29 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1248 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:29.686818 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-01c63f3c-bc1d-4025-8707-96aaa02eb026 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:29.687412 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-01c63f3c-bc1d-4025-8707-96aaa02eb026 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:29.693990 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-01c63f3c-bc1d-4025-8707-96aaa02eb026 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:29.694444 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-01c63f3c-bc1d-4025-8707-96aaa02eb026 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:29.695240 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-01c63f3c-bc1d-4025-8707-96aaa02eb026 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:29.695680 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-01c63f3c-bc1d-4025-8707-96aaa02eb026 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:29.829382 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-01c63f3c-bc1d-4025-8707-96aaa02eb026 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:29.837294 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-01c63f3c-bc1d-4025-8707-96aaa02eb026 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:29.839446 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-01c63f3c-bc1d-4025-8707-96aaa02eb026 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:29.841083 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-01c63f3c-bc1d-4025-8707-96aaa02eb026 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1721 microversion: 2.20 time: 0.158236 Jun 15 14:46:29.841637 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 217/455] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:29 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:30.199358 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-fb8937ed-09bb-4f53-bd58-e779ad5cf6b8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:30.199971 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-fb8937ed-09bb-4f53-bd58-e779ad5cf6b8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:30.206510 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fb8937ed-09bb-4f53-bd58-e779ad5cf6b8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:30.206965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fb8937ed-09bb-4f53-bd58-e779ad5cf6b8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:30.207727 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fb8937ed-09bb-4f53-bd58-e779ad5cf6b8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:30.208168 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fb8937ed-09bb-4f53-bd58-e779ad5cf6b8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:30.271289 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-fb8937ed-09bb-4f53-bd58-e779ad5cf6b8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:30.279343 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-fb8937ed-09bb-4f53-bd58-e779ad5cf6b8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1248 microversion: 2.1 time: 0.084778 Jun 15 14:46:30.279909 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 239/456] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:30 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1248 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:30.865838 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c73818b2-c531-4692-bea6-ba51a7e6a055 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:30.866579 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-c73818b2-c531-4692-bea6-ba51a7e6a055 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:30.874171 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c73818b2-c531-4692-bea6-ba51a7e6a055 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:30.874624 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c73818b2-c531-4692-bea6-ba51a7e6a055 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:30.875399 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c73818b2-c531-4692-bea6-ba51a7e6a055 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:30.875838 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c73818b2-c531-4692-bea6-ba51a7e6a055 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:31.010889 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-c73818b2-c531-4692-bea6-ba51a7e6a055 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:31.018960 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-c73818b2-c531-4692-bea6-ba51a7e6a055 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:31.020460 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-c73818b2-c531-4692-bea6-ba51a7e6a055 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:31.021613 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-c73818b2-c531-4692-bea6-ba51a7e6a055 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1721 microversion: 2.20 time: 0.160196 Jun 15 14:46:31.022180 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 218/457] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:30 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:31.297686 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-92e115b3-7e9c-4670-90bb-4905574b88b2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:31.298422 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-92e115b3-7e9c-4670-90bb-4905574b88b2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:31.306309 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-92e115b3-7e9c-4670-90bb-4905574b88b2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:31.307714 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-92e115b3-7e9c-4670-90bb-4905574b88b2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:31.308702 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-92e115b3-7e9c-4670-90bb-4905574b88b2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:31.310056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-92e115b3-7e9c-4670-90bb-4905574b88b2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:31.378634 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-92e115b3-7e9c-4670-90bb-4905574b88b2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:31.387656 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-92e115b3-7e9c-4670-90bb-4905574b88b2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1240 microversion: 2.1 time: 0.093853 Jun 15 14:46:31.388216 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 240/458] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:31 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1240 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:31.491060 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-327d9f74-a59e-4ae8-bdab-db5ddd1bf91d req-4dc2836c-734b-4a2e-b181-59d580d97cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123ea48b-cb21-429c-85c6-0ae71d51c1c0", "name": "network-vif-unplugged", "status": "completed", "tag": "3b30c106-589d-4777-be4f-8c3b882d514e"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:46:31.503820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-327d9f74-a59e-4ae8-bdab-db5ddd1bf91d req-4dc2836c-734b-4a2e-b181-59d580d97cd1 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:31.504844 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-327d9f74-a59e-4ae8-bdab-db5ddd1bf91d req-4dc2836c-734b-4a2e-b181-59d580d97cd1 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:31.519164 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-327d9f74-a59e-4ae8-bdab-db5ddd1bf91d req-4dc2836c-734b-4a2e-b181-59d580d97cd1 service nova] Creating event network-vif-unplugged:3b30c106-589d-4777-be4f-8c3b882d514e for instance 123ea48b-cb21-429c-85c6-0ae71d51c1c0 on hv-cinder-84327 Jun 15 14:46:31.524521 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-327d9f74-a59e-4ae8-bdab-db5ddd1bf91d req-4dc2836c-734b-4a2e-b181-59d580d97cd1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037896 Jun 15 14:46:31.526913 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 219/459] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:46:32.039559 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-db86c688-e254-4928-9dfd-7f45fad2c94a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:32.040191 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-db86c688-e254-4928-9dfd-7f45fad2c94a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:32.046578 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-db86c688-e254-4928-9dfd-7f45fad2c94a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:32.047027 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-db86c688-e254-4928-9dfd-7f45fad2c94a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:32.047792 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-db86c688-e254-4928-9dfd-7f45fad2c94a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:32.048227 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-db86c688-e254-4928-9dfd-7f45fad2c94a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:32.187393 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-db86c688-e254-4928-9dfd-7f45fad2c94a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:32.195422 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-db86c688-e254-4928-9dfd-7f45fad2c94a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:32.196936 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-db86c688-e254-4928-9dfd-7f45fad2c94a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:32.198722 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-db86c688-e254-4928-9dfd-7f45fad2c94a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1724 microversion: 2.20 time: 0.163032 Jun 15 14:46:32.199272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 241/460] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:32 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:32.217553 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6862e72b-1aa2-4430-bfc8-6ebc5503d308 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f044674c-a1de-4998-a465-df6831ec1756"}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:46:32.218773 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6862e72b-1aa2-4430-bfc8-6ebc5503d308 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:32.224904 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6862e72b-1aa2-4430-bfc8-6ebc5503d308 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:32.225296 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6862e72b-1aa2-4430-bfc8-6ebc5503d308 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:32.226072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6862e72b-1aa2-4430-bfc8-6ebc5503d308 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:32.226514 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6862e72b-1aa2-4430-bfc8-6ebc5503d308 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:32.405030 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-d6ffbc3c-92bc-4f98-8b0f-b182c81aad41 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:32.406291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-d6ffbc3c-92bc-4f98-8b0f-b182c81aad41 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:32.413917 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d6ffbc3c-92bc-4f98-8b0f-b182c81aad41 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:32.414371 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d6ffbc3c-92bc-4f98-8b0f-b182c81aad41 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:32.415140 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d6ffbc3c-92bc-4f98-8b0f-b182c81aad41 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:32.415577 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d6ffbc3c-92bc-4f98-8b0f-b182c81aad41 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:32.482313 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d6ffbc3c-92bc-4f98-8b0f-b182c81aad41 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:32.489952 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-d6ffbc3c-92bc-4f98-8b0f-b182c81aad41 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1296 microversion: 2.1 time: 0.089505 Jun 15 14:46:32.490513 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 242/461] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:32 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1296 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:32.518471 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-6862e72b-1aa2-4430-bfc8-6ebc5503d308 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "POST /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.306011 Jun 15 14:46:32.519088 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 220/462] 10.222.0.57 () {62 vars in 1363 bytes} [Wed Jun 15 14:46:32 2022] POST /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0/os-volume_attachments => generated 188 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:46:32.527221 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-07721645-1748-492f-8173-de2f3e772485 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:46:32.528402 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-07721645-1748-492f-8173-de2f3e772485 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:32.536396 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-07721645-1748-492f-8173-de2f3e772485 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:32.536839 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-07721645-1748-492f-8173-de2f3e772485 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:32.537601 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-07721645-1748-492f-8173-de2f3e772485 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:32.538077 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-07721645-1748-492f-8173-de2f3e772485 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:32.616758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-07721645-1748-492f-8173-de2f3e772485 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "POST /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e/action" status: 202 len: 0 microversion: 2.1 time: 0.094618 Jun 15 14:46:32.618760 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 243/463] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 14:46:32 2022] POST /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:46:32.627405 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-957600c2-da17-4367-b9a3-b8c653af6302 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:32.628052 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-957600c2-da17-4367-b9a3-b8c653af6302 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:32.637309 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-957600c2-da17-4367-b9a3-b8c653af6302 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:32.637797 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-957600c2-da17-4367-b9a3-b8c653af6302 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:32.638793 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-957600c2-da17-4367-b9a3-b8c653af6302 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:32.639245 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-957600c2-da17-4367-b9a3-b8c653af6302 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:32.652253 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-17ef3071-73db-4830-9943-f58cd253d03e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:46:32.653062 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-17ef3071-73db-4830-9943-f58cd253d03e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:32.661332 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-17ef3071-73db-4830-9943-f58cd253d03e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:32.661825 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-17ef3071-73db-4830-9943-f58cd253d03e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:32.662580 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-17ef3071-73db-4830-9943-f58cd253d03e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:32.663431 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-17ef3071-73db-4830-9943-f58cd253d03e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:32.760166 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-17ef3071-73db-4830-9943-f58cd253d03e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "POST /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0/action" status: 202 len: 0 microversion: 2.20 time: 0.112942 Jun 15 14:46:32.763964 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 244/464] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Jun 15 14:46:32 2022] POST /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:46:32.768779 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-37445160-3848-4ed7-8234-6b6910deef1b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:32.769687 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-37445160-3848-4ed7-8234-6b6910deef1b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:32.778031 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-37445160-3848-4ed7-8234-6b6910deef1b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:32.778831 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-37445160-3848-4ed7-8234-6b6910deef1b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:32.779623 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-37445160-3848-4ed7-8234-6b6910deef1b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:32.780094 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-37445160-3848-4ed7-8234-6b6910deef1b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:32.786698 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:32.811324 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-957600c2-da17-4367-b9a3-b8c653af6302 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:32.824179 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-957600c2-da17-4367-b9a3-b8c653af6302 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1753 microversion: 2.1 time: 0.201509 Jun 15 14:46:32.825055 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 221/465] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:32 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1753 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:32.943288 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-37445160-3848-4ed7-8234-6b6910deef1b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:32.952043 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-37445160-3848-4ed7-8234-6b6910deef1b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:32.953606 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-37445160-3848-4ed7-8234-6b6910deef1b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:32.954887 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-37445160-3848-4ed7-8234-6b6910deef1b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1810 microversion: 2.20 time: 0.189972 Jun 15 14:46:32.955444 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 245/466] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:32 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:46:33.507682 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-edb25131-54c9-4579-a819-ed3627cd1f6d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:33.508431 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-edb25131-54c9-4579-a819-ed3627cd1f6d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:33.517257 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-edb25131-54c9-4579-a819-ed3627cd1f6d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:33.517961 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-edb25131-54c9-4579-a819-ed3627cd1f6d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:33.518807 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-edb25131-54c9-4579-a819-ed3627cd1f6d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:33.519311 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-edb25131-54c9-4579-a819-ed3627cd1f6d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:33.596765 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-edb25131-54c9-4579-a819-ed3627cd1f6d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:33.608347 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-edb25131-54c9-4579-a819-ed3627cd1f6d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1314 microversion: 2.1 time: 0.104414 Jun 15 14:46:33.609019 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 222/467] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:33 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1314 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:33.842119 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-14bff56b-d4d6-493c-bd42-b31f14e8c81b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:33.843263 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-14bff56b-d4d6-493c-bd42-b31f14e8c81b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:33.850386 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-14bff56b-d4d6-493c-bd42-b31f14e8c81b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:33.850929 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-14bff56b-d4d6-493c-bd42-b31f14e8c81b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:33.851860 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-14bff56b-d4d6-493c-bd42-b31f14e8c81b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:33.852364 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-14bff56b-d4d6-493c-bd42-b31f14e8c81b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:33.974394 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-2d0b4e4a-a583-4c77-a720-f9565159febc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:33.975734 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-2d0b4e4a-a583-4c77-a720-f9565159febc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:33.982778 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2d0b4e4a-a583-4c77-a720-f9565159febc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:33.983224 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2d0b4e4a-a583-4c77-a720-f9565159febc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:33.983985 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2d0b4e4a-a583-4c77-a720-f9565159febc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:33.984416 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2d0b4e4a-a583-4c77-a720-f9565159febc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:33.998344 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-14bff56b-d4d6-493c-bd42-b31f14e8c81b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:34.006991 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-14bff56b-d4d6-493c-bd42-b31f14e8c81b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1753 microversion: 2.1 time: 0.170235 Jun 15 14:46:34.007765 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 246/468] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:33 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:34.209516 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-2d0b4e4a-a583-4c77-a720-f9565159febc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:34.219890 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-2d0b4e4a-a583-4c77-a720-f9565159febc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:34.221546 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-2d0b4e4a-a583-4c77-a720-f9565159febc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:34.222838 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-2d0b4e4a-a583-4c77-a720-f9565159febc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1750 microversion: 2.20 time: 0.252363 Jun 15 14:46:34.223408 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 223/469] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:33 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1750 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:46:34.626004 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-ccb1dbc2-2488-483f-9df9-3b149fb7e61b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:34.626845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-ccb1dbc2-2488-483f-9df9-3b149fb7e61b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:34.635982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ccb1dbc2-2488-483f-9df9-3b149fb7e61b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:34.636717 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ccb1dbc2-2488-483f-9df9-3b149fb7e61b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:34.637493 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ccb1dbc2-2488-483f-9df9-3b149fb7e61b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:34.637951 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ccb1dbc2-2488-483f-9df9-3b149fb7e61b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:34.826223 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-ccb1dbc2-2488-483f-9df9-3b149fb7e61b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:34.838539 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-ccb1dbc2-2488-483f-9df9-3b149fb7e61b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1370 microversion: 2.1 time: 0.216702 Jun 15 14:46:34.842605 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 247/470] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:34 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1370 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:35.024343 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-7fa0c4ac-63bf-46d4-ad68-d258deca87e1 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:35.025102 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-7fa0c4ac-63bf-46d4-ad68-d258deca87e1 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:35.032067 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7fa0c4ac-63bf-46d4-ad68-d258deca87e1 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:35.032517 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7fa0c4ac-63bf-46d4-ad68-d258deca87e1 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:35.033277 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7fa0c4ac-63bf-46d4-ad68-d258deca87e1 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:35.033739 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7fa0c4ac-63bf-46d4-ad68-d258deca87e1 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:35.242284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-9b065714-5ea8-40b7-8bf8-91c2c6a317ef tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:35.242950 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-9b065714-5ea8-40b7-8bf8-91c2c6a317ef tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:35.249895 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9b065714-5ea8-40b7-8bf8-91c2c6a317ef tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:35.250347 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9b065714-5ea8-40b7-8bf8-91c2c6a317ef tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:35.252237 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9b065714-5ea8-40b7-8bf8-91c2c6a317ef tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:35.252237 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9b065714-5ea8-40b7-8bf8-91c2c6a317ef tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:35.253225 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-7fa0c4ac-63bf-46d4-ad68-d258deca87e1 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:35.263559 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-7fa0c4ac-63bf-46d4-ad68-d258deca87e1 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1758 microversion: 2.1 time: 0.243070 Jun 15 14:46:35.266442 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 224/471] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:35 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1758 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:35.423766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-9b065714-5ea8-40b7-8bf8-91c2c6a317ef tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:35.434314 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-9b065714-5ea8-40b7-8bf8-91c2c6a317ef tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:35.436049 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-9b065714-5ea8-40b7-8bf8-91c2c6a317ef tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:35.437321 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-9b065714-5ea8-40b7-8bf8-91c2c6a317ef tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1752 microversion: 2.20 time: 0.199158 Jun 15 14:46:35.438467 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 248/472] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:35 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1752 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:46:35.549893 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-3d3f0e76-bc67-4f1a-9425-f40b3d36287a req-f7adee79-8ca7-4366-b37a-7cec13f779fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7677949-b0c4-4f8a-bf16-26a4c639c344", "tag": "faff7f9d-2ca1-439d-8ffd-5a9dad77ee86"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:46:35.561456 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-3d3f0e76-bc67-4f1a-9425-f40b3d36287a req-f7adee79-8ca7-4366-b37a-7cec13f779fc service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:35.562256 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-3d3f0e76-bc67-4f1a-9425-f40b3d36287a req-f7adee79-8ca7-4366-b37a-7cec13f779fc service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:35.577884 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-3d3f0e76-bc67-4f1a-9425-f40b3d36287a req-f7adee79-8ca7-4366-b37a-7cec13f779fc service nova] Creating event network-changed:faff7f9d-2ca1-439d-8ffd-5a9dad77ee86 for instance c7677949-b0c4-4f8a-bf16-26a4c639c344 on hv-cinder-84327 Jun 15 14:46:35.583007 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-3d3f0e76-bc67-4f1a-9425-f40b3d36287a req-f7adee79-8ca7-4366-b37a-7cec13f779fc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037375 Jun 15 14:46:35.583599 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 225/473] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:46:35.865236 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-cbfa2738-39e1-4a70-90a1-5df8e26dbe6f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:35.866054 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-cbfa2738-39e1-4a70-90a1-5df8e26dbe6f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:35.873389 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-cbfa2738-39e1-4a70-90a1-5df8e26dbe6f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:35.874476 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-cbfa2738-39e1-4a70-90a1-5df8e26dbe6f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:35.876633 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-cbfa2738-39e1-4a70-90a1-5df8e26dbe6f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:35.877095 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-cbfa2738-39e1-4a70-90a1-5df8e26dbe6f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:36.031853 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-cbfa2738-39e1-4a70-90a1-5df8e26dbe6f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:36.039934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-cbfa2738-39e1-4a70-90a1-5df8e26dbe6f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1370 microversion: 2.1 time: 0.181893 Jun 15 14:46:36.040515 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 249/474] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:35 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:36.299546 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-2267d142-e66d-4960-b253-53c01f681bdf tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:36.300353 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-2267d142-e66d-4960-b253-53c01f681bdf tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:36.309767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2267d142-e66d-4960-b253-53c01f681bdf tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:36.310502 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2267d142-e66d-4960-b253-53c01f681bdf tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:36.311310 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2267d142-e66d-4960-b253-53c01f681bdf tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:36.311765 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2267d142-e66d-4960-b253-53c01f681bdf tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:36.458521 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0e0c5c0a-b4ff-4c73-b5f7-a5d4b078e09b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:36.459364 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-0e0c5c0a-b4ff-4c73-b5f7-a5d4b078e09b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:36.466053 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0e0c5c0a-b4ff-4c73-b5f7-a5d4b078e09b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:36.466505 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0e0c5c0a-b4ff-4c73-b5f7-a5d4b078e09b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:36.467286 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0e0c5c0a-b4ff-4c73-b5f7-a5d4b078e09b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:36.467718 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0e0c5c0a-b4ff-4c73-b5f7-a5d4b078e09b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:36.497830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-2267d142-e66d-4960-b253-53c01f681bdf tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:36.506738 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-2267d142-e66d-4960-b253-53c01f681bdf tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1758 microversion: 2.1 time: 0.226557 Jun 15 14:46:36.507406 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 226/475] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:36 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1758 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:36.630170 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0e0c5c0a-b4ff-4c73-b5f7-a5d4b078e09b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:36.639635 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0e0c5c0a-b4ff-4c73-b5f7-a5d4b078e09b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:36.641136 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0e0c5c0a-b4ff-4c73-b5f7-a5d4b078e09b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:36.642365 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-0e0c5c0a-b4ff-4c73-b5f7-a5d4b078e09b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.189239 Jun 15 14:46:36.642922 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 250/476] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:36 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:46:37.015957 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-93ec991b-6cc6-4a76-85cc-071cad025dc2 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-258122925", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1261933231", "security_groups": [{"name": "tempest-secgroup-smoke-499501397"}], "block_device_mapping_v2": [{"uuid": "f935187d-c64c-4422-a3b3-3f6723a576f3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e7b389d2-b470-4005-95f3-38993d2e4479"}]}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:46:37.024189 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=2 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:37.024847 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=6 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:37.059332 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f895094e-4079-4674-b7d2-9945a69f0715 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:37.060016 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f895094e-4079-4674-b7d2-9945a69f0715 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:37.066357 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f895094e-4079-4674-b7d2-9945a69f0715 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:37.066870 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f895094e-4079-4674-b7d2-9945a69f0715 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:37.067713 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f895094e-4079-4674-b7d2-9945a69f0715 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:37.068213 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f895094e-4079-4674-b7d2-9945a69f0715 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:37.130869 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.network.neutron [None req-93ec991b-6cc6-4a76-85cc-071cad025dc2 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] validate_networks() for [('e7b389d2-b470-4005-95f3-38993d2e4479', None, None, None, None, None)] {{(pid=124220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:46:37.206540 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f895094e-4079-4674-b7d2-9945a69f0715 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:37.214660 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f895094e-4079-4674-b7d2-9945a69f0715 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1370 microversion: 2.1 time: 0.160429 Jun 15 14:46:37.215238 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 251/477] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:37 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:37.511894 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-93ec991b-6cc6-4a76-85cc-071cad025dc2 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Flavor limits 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:46:37.512376 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-93ec991b-6cc6-4a76-85cc-071cad025dc2 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Image limits 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:46:37.512790 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-93ec991b-6cc6-4a76-85cc-071cad025dc2 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Flavor pref 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:46:37.513235 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-93ec991b-6cc6-4a76-85cc-071cad025dc2 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Image pref 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:46:37.513728 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-93ec991b-6cc6-4a76-85cc-071cad025dc2 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:46:37.523284 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-93ec991b-6cc6-4a76-85cc-071cad025dc2 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:37.523736 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-93ec991b-6cc6-4a76-85cc-071cad025dc2 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:37.524557 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-a921669e-1350-4f35-98d0-4b17581ac2a5 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:37.524686 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-93ec991b-6cc6-4a76-85cc-071cad025dc2 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:37.524997 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-93ec991b-6cc6-4a76-85cc-071cad025dc2 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:37.525173 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-a921669e-1350-4f35-98d0-4b17581ac2a5 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:37.532697 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a921669e-1350-4f35-98d0-4b17581ac2a5 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:37.533156 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a921669e-1350-4f35-98d0-4b17581ac2a5 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:37.534086 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a921669e-1350-4f35-98d0-4b17581ac2a5 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:37.534592 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a921669e-1350-4f35-98d0-4b17581ac2a5 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:37.543232 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-93ec991b-6cc6-4a76-85cc-071cad025dc2 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Getting quotas for project 2350f7b62a7d4d8199faf8b18b2ca8dc. Resources: {'cores', 'instances', 'ram'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:46:37.547242 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-93ec991b-6cc6-4a76-85cc-071cad025dc2 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Getting quotas for user 67d64cad336c44d28c9cf31fc9896854 and project 2350f7b62a7d4d8199faf8b18b2ca8dc. Resources: {'cores', 'instances', 'ram'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:46:37.606957 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-93ec991b-6cc6-4a76-85cc-071cad025dc2 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Going to run 1 instances... {{(pid=124220) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:46:37.609040 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-93ec991b-6cc6-4a76-85cc-071cad025dc2 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f935187d-c64c-4422-a3b3-3f6723a576f3',volume_size=None,volume_type=None)] {{(pid=124220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:46:37.684980 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-a921669e-1350-4f35-98d0-4b17581ac2a5 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:37.692984 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-a921669e-1350-4f35-98d0-4b17581ac2a5 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1758 microversion: 2.1 time: 0.172489 Jun 15 14:46:37.693894 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 252/478] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:37 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:37.699805 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-8bba4d80-d056-42f1-a8c2-7a6ded73ccd4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:37.700469 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-8bba4d80-d056-42f1-a8c2-7a6ded73ccd4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:37.706445 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8bba4d80-d056-42f1-a8c2-7a6ded73ccd4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:37.706892 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8bba4d80-d056-42f1-a8c2-7a6ded73ccd4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:37.707650 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8bba4d80-d056-42f1-a8c2-7a6ded73ccd4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:37.708089 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8bba4d80-d056-42f1-a8c2-7a6ded73ccd4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:37.749385 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-93ec991b-6cc6-4a76-85cc-071cad025dc2 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.737200 Jun 15 14:46:37.750647 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 227/479] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 14:46:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:46:37.761148 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-4bcc605f-4bd2-4edf-ac38-78632d4f90f7 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:37.761825 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-4bcc605f-4bd2-4edf-ac38-78632d4f90f7 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:37.817994 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-4bcc605f-4bd2-4edf-ac38-78632d4f90f7 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:37.829838 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-4bcc605f-4bd2-4edf-ac38-78632d4f90f7 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1094 microversion: 2.1 time: 0.073039 Jun 15 14:46:37.830431 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 228/480] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:37 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:37.860512 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-8bba4d80-d056-42f1-a8c2-7a6ded73ccd4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:37.868820 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-8bba4d80-d056-42f1-a8c2-7a6ded73ccd4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:37.871062 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-8bba4d80-d056-42f1-a8c2-7a6ded73ccd4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:37.872249 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-8bba4d80-d056-42f1-a8c2-7a6ded73ccd4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.177244 Jun 15 14:46:37.872820 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 253/481] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:37 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:38.232649 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-5de6a62b-d817-44b7-9445-704b54dba5ba tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:38.233166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-5de6a62b-d817-44b7-9445-704b54dba5ba tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:38.239147 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5de6a62b-d817-44b7-9445-704b54dba5ba tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:38.239590 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5de6a62b-d817-44b7-9445-704b54dba5ba tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:38.240344 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5de6a62b-d817-44b7-9445-704b54dba5ba tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:38.240777 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5de6a62b-d817-44b7-9445-704b54dba5ba tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:38.383269 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-5de6a62b-d817-44b7-9445-704b54dba5ba tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:38.392115 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-5de6a62b-d817-44b7-9445-704b54dba5ba tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1370 microversion: 2.1 time: 0.164440 Jun 15 14:46:38.392681 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 229/482] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:38 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:38.711990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-d775ad5b-89dc-47f3-9a1c-0b7e5745d947 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:38.712809 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-d775ad5b-89dc-47f3-9a1c-0b7e5745d947 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:38.715072 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=2 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:38.721472 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d775ad5b-89dc-47f3-9a1c-0b7e5745d947 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:38.721949 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d775ad5b-89dc-47f3-9a1c-0b7e5745d947 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:38.722743 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d775ad5b-89dc-47f3-9a1c-0b7e5745d947 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:38.723183 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d775ad5b-89dc-47f3-9a1c-0b7e5745d947 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:38.848397 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-e9f94690-c8e7-4766-b749-3e43b0727779 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:38.850582 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-e9f94690-c8e7-4766-b749-3e43b0727779 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:38.860549 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e9f94690-c8e7-4766-b749-3e43b0727779 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:38.861283 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e9f94690-c8e7-4766-b749-3e43b0727779 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:38.862356 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e9f94690-c8e7-4766-b749-3e43b0727779 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:38.862796 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e9f94690-c8e7-4766-b749-3e43b0727779 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:38.938301 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e9f94690-c8e7-4766-b749-3e43b0727779 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:38.947060 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-e9f94690-c8e7-4766-b749-3e43b0727779 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1192 microversion: 2.1 time: 0.102755 Jun 15 14:46:38.957395 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 230/483] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:38 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1192 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:38.962521 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-e2e30d17-3204-47f2-9535-c933a1e2ebad tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:38.963865 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-e2e30d17-3204-47f2-9535-c933a1e2ebad tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:38.971060 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e2e30d17-3204-47f2-9535-c933a1e2ebad tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:38.971749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e2e30d17-3204-47f2-9535-c933a1e2ebad tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:38.972748 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e2e30d17-3204-47f2-9535-c933a1e2ebad tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:38.973188 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e2e30d17-3204-47f2-9535-c933a1e2ebad tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:39.082653 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d775ad5b-89dc-47f3-9a1c-0b7e5745d947 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:39.091798 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-d775ad5b-89dc-47f3-9a1c-0b7e5745d947 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1758 microversion: 2.1 time: 0.384410 Jun 15 14:46:39.092586 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 254/484] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:38 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1758 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:39.123760 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e2e30d17-3204-47f2-9535-c933a1e2ebad tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:39.132202 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e2e30d17-3204-47f2-9535-c933a1e2ebad tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:39.133804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e2e30d17-3204-47f2-9535-c933a1e2ebad tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:39.135469 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-e2e30d17-3204-47f2-9535-c933a1e2ebad tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.176188 Jun 15 14:46:39.136016 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 231/485] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:38 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:39.409295 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-415bde78-3599-46d8-8e38-95e5bed15826 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:39.409941 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-415bde78-3599-46d8-8e38-95e5bed15826 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:39.416010 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-415bde78-3599-46d8-8e38-95e5bed15826 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:39.417084 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-415bde78-3599-46d8-8e38-95e5bed15826 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:39.418403 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-415bde78-3599-46d8-8e38-95e5bed15826 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:39.419288 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-415bde78-3599-46d8-8e38-95e5bed15826 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:39.675480 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-415bde78-3599-46d8-8e38-95e5bed15826 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:39.682942 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-415bde78-3599-46d8-8e38-95e5bed15826 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1370 microversion: 2.1 time: 0.277385 Jun 15 14:46:39.684905 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 255/486] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:39 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1370 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:39.966760 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1b8924f8-c088-4b05-ba8f-41fe8818b458 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:39.967852 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1b8924f8-c088-4b05-ba8f-41fe8818b458 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:39.974699 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1b8924f8-c088-4b05-ba8f-41fe8818b458 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:39.975356 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1b8924f8-c088-4b05-ba8f-41fe8818b458 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:39.976236 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1b8924f8-c088-4b05-ba8f-41fe8818b458 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:39.976649 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1b8924f8-c088-4b05-ba8f-41fe8818b458 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:39.998373 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:40.057539 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-1b8924f8-c088-4b05-ba8f-41fe8818b458 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:40.067994 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-1b8924f8-c088-4b05-ba8f-41fe8818b458 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1210 microversion: 2.1 time: 0.107093 Jun 15 14:46:40.068631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 232/487] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:39 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1210 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:40.108897 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-2d2cd922-4779-4ce7-88f2-3f79de367c72 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:40.109563 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-2d2cd922-4779-4ce7-88f2-3f79de367c72 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:40.116306 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2d2cd922-4779-4ce7-88f2-3f79de367c72 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:40.116762 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2d2cd922-4779-4ce7-88f2-3f79de367c72 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:40.117535 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2d2cd922-4779-4ce7-88f2-3f79de367c72 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:40.118006 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2d2cd922-4779-4ce7-88f2-3f79de367c72 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:40.155927 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-07f73358-cd71-4b10-bb85-746eee72e36c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:40.156621 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-07f73358-cd71-4b10-bb85-746eee72e36c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:40.165789 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-07f73358-cd71-4b10-bb85-746eee72e36c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:40.166237 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-07f73358-cd71-4b10-bb85-746eee72e36c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:40.167017 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-07f73358-cd71-4b10-bb85-746eee72e36c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:40.167454 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-07f73358-cd71-4b10-bb85-746eee72e36c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:40.345376 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-2d2cd922-4779-4ce7-88f2-3f79de367c72 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:40.354222 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-2d2cd922-4779-4ce7-88f2-3f79de367c72 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1758 microversion: 2.1 time: 0.249694 Jun 15 14:46:40.354791 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 256/488] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:40 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1758 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:40.403123 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-07f73358-cd71-4b10-bb85-746eee72e36c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:40.416717 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-07f73358-cd71-4b10-bb85-746eee72e36c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:40.418804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-07f73358-cd71-4b10-bb85-746eee72e36c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:40.420151 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-07f73358-cd71-4b10-bb85-746eee72e36c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.269314 Jun 15 14:46:40.420816 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 233/489] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:40 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:46:40.702005 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-daf45a46-f8a4-4bcc-acac-a803f2467ebb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:40.702693 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-daf45a46-f8a4-4bcc-acac-a803f2467ebb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:40.708769 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-daf45a46-f8a4-4bcc-acac-a803f2467ebb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:40.709477 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-daf45a46-f8a4-4bcc-acac-a803f2467ebb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:40.711101 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-daf45a46-f8a4-4bcc-acac-a803f2467ebb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:40.711607 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-daf45a46-f8a4-4bcc-acac-a803f2467ebb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:40.924919 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-daf45a46-f8a4-4bcc-acac-a803f2467ebb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:40.948613 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-daf45a46-f8a4-4bcc-acac-a803f2467ebb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1370 microversion: 2.1 time: 0.250898 Jun 15 14:46:40.950892 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 257/490] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:40 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1370 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:41.086356 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-5aeea901-7a0e-4833-b874-4ae25a33a929 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:41.087649 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-5aeea901-7a0e-4833-b874-4ae25a33a929 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:41.103146 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5aeea901-7a0e-4833-b874-4ae25a33a929 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:41.103828 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5aeea901-7a0e-4833-b874-4ae25a33a929 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:41.104920 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5aeea901-7a0e-4833-b874-4ae25a33a929 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:41.105835 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5aeea901-7a0e-4833-b874-4ae25a33a929 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:41.372699 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-aa261488-7420-41ad-8504-6587120618d3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:41.373315 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-aa261488-7420-41ad-8504-6587120618d3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:41.390888 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-aa261488-7420-41ad-8504-6587120618d3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:41.391629 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-aa261488-7420-41ad-8504-6587120618d3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:41.392580 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-aa261488-7420-41ad-8504-6587120618d3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:41.393167 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-aa261488-7420-41ad-8504-6587120618d3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:41.435324 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-5aeea901-7a0e-4833-b874-4ae25a33a929 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:41.461574 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-5aeea901-7a0e-4833-b874-4ae25a33a929 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1277 microversion: 2.1 time: 0.379343 Jun 15 14:46:41.467060 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 234/491] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:41 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1277 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:41.486107 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-eed7227b-90a1-4524-8858-dbb7c2773a0e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:41.487177 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-eed7227b-90a1-4524-8858-dbb7c2773a0e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:41.494075 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-eed7227b-90a1-4524-8858-dbb7c2773a0e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:41.494536 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-eed7227b-90a1-4524-8858-dbb7c2773a0e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:41.495342 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-eed7227b-90a1-4524-8858-dbb7c2773a0e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:41.496582 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-eed7227b-90a1-4524-8858-dbb7c2773a0e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:41.643956 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-aa261488-7420-41ad-8504-6587120618d3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:41.655956 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-aa261488-7420-41ad-8504-6587120618d3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1758 microversion: 2.1 time: 0.288457 Jun 15 14:46:41.666458 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 258/492] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:41 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1758 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:41.725653 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-eed7227b-90a1-4524-8858-dbb7c2773a0e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:41.735662 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-eed7227b-90a1-4524-8858-dbb7c2773a0e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:41.737261 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-eed7227b-90a1-4524-8858-dbb7c2773a0e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:41.738564 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-eed7227b-90a1-4524-8858-dbb7c2773a0e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.269890 Jun 15 14:46:41.739209 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 235/493] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:41 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:41.782331 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-0d30be07-d6d9-4d9e-b8fb-3ed34eb78389 req-069a2de0-7a97-48a3-a159-ba92564b1be6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9104e014-d497-460a-8215-6439f0a2e521", "tag": "bc9c90a6-a5e4-499e-bc4a-d030962cd9bc"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:46:41.791363 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-ec23f2ee-8f1a-406b-9b69-6edf748e6de7 req-2e0adf83-1146-42d9-bbc5-55d8becd6966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7677949-b0c4-4f8a-bf16-26a4c639c344", "name": "network-vif-plugged", "status": "completed", "tag": "faff7f9d-2ca1-439d-8ffd-5a9dad77ee86"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:46:41.810715 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-ec23f2ee-8f1a-406b-9b69-6edf748e6de7 req-2e0adf83-1146-42d9-bbc5-55d8becd6966 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:41.811175 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-ec23f2ee-8f1a-406b-9b69-6edf748e6de7 req-2e0adf83-1146-42d9-bbc5-55d8becd6966 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:41.832706 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-0d30be07-d6d9-4d9e-b8fb-3ed34eb78389 req-069a2de0-7a97-48a3-a159-ba92564b1be6 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:41.834458 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-0d30be07-d6d9-4d9e-b8fb-3ed34eb78389 req-069a2de0-7a97-48a3-a159-ba92564b1be6 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:41.834788 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-ec23f2ee-8f1a-406b-9b69-6edf748e6de7 req-2e0adf83-1146-42d9-bbc5-55d8becd6966 service nova] Creating event network-vif-plugged:faff7f9d-2ca1-439d-8ffd-5a9dad77ee86 for instance c7677949-b0c4-4f8a-bf16-26a4c639c344 on hv-cinder-84327 Jun 15 14:46:41.850247 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-ec23f2ee-8f1a-406b-9b69-6edf748e6de7 req-2e0adf83-1146-42d9-bbc5-55d8becd6966 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062124 Jun 15 14:46:41.851679 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 236/494] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:46:41.864147 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-0d30be07-d6d9-4d9e-b8fb-3ed34eb78389 req-069a2de0-7a97-48a3-a159-ba92564b1be6 service nova] Creating event network-changed:bc9c90a6-a5e4-499e-bc4a-d030962cd9bc for instance 9104e014-d497-460a-8215-6439f0a2e521 on hv-cinder-84327 Jun 15 14:46:41.874161 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-0d30be07-d6d9-4d9e-b8fb-3ed34eb78389 req-069a2de0-7a97-48a3-a159-ba92564b1be6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093042 Jun 15 14:46:41.875109 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 259/495] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:46:41.968433 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-da9c5d5c-aca6-4f63-8208-78bbfc0a5cdc tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:41.969130 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-da9c5d5c-aca6-4f63-8208-78bbfc0a5cdc tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:41.975611 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-da9c5d5c-aca6-4f63-8208-78bbfc0a5cdc tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:41.976054 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-da9c5d5c-aca6-4f63-8208-78bbfc0a5cdc tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:41.976923 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-da9c5d5c-aca6-4f63-8208-78bbfc0a5cdc tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:41.977353 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-da9c5d5c-aca6-4f63-8208-78bbfc0a5cdc tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:42.134228 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-da9c5d5c-aca6-4f63-8208-78bbfc0a5cdc tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:42.142776 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-da9c5d5c-aca6-4f63-8208-78bbfc0a5cdc tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1370 microversion: 2.1 time: 0.179445 Jun 15 14:46:42.143339 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 237/496] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:41 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:42.484799 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-1b7fbfda-78d5-49ed-a3f3-a10647b28d15 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:42.485518 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-1b7fbfda-78d5-49ed-a3f3-a10647b28d15 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:42.493186 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1b7fbfda-78d5-49ed-a3f3-a10647b28d15 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:42.493697 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1b7fbfda-78d5-49ed-a3f3-a10647b28d15 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:42.494712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1b7fbfda-78d5-49ed-a3f3-a10647b28d15 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:42.495264 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1b7fbfda-78d5-49ed-a3f3-a10647b28d15 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:42.639999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-1b7fbfda-78d5-49ed-a3f3-a10647b28d15 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:42.647407 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-1b7fbfda-78d5-49ed-a3f3-a10647b28d15 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1277 microversion: 2.1 time: 0.167874 Jun 15 14:46:42.647966 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 260/497] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:42 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:42.672790 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-9ee419fc-eb97-4812-aebb-282a359b271a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:42.673388 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-9ee419fc-eb97-4812-aebb-282a359b271a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:42.680092 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9ee419fc-eb97-4812-aebb-282a359b271a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:42.680569 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9ee419fc-eb97-4812-aebb-282a359b271a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:42.681571 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9ee419fc-eb97-4812-aebb-282a359b271a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:42.681932 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9ee419fc-eb97-4812-aebb-282a359b271a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:42.756520 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-1037f1a5-435a-404a-8da8-0d6ad9dc2a16 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:42.757292 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-1037f1a5-435a-404a-8da8-0d6ad9dc2a16 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:42.764887 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1037f1a5-435a-404a-8da8-0d6ad9dc2a16 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:42.765324 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1037f1a5-435a-404a-8da8-0d6ad9dc2a16 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:42.766111 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1037f1a5-435a-404a-8da8-0d6ad9dc2a16 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:42.766544 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1037f1a5-435a-404a-8da8-0d6ad9dc2a16 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:42.864794 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9ee419fc-eb97-4812-aebb-282a359b271a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:42.879752 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-9ee419fc-eb97-4812-aebb-282a359b271a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1758 microversion: 2.1 time: 0.210726 Jun 15 14:46:42.880735 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 238/498] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:42 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1758 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:42.931908 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-1037f1a5-435a-404a-8da8-0d6ad9dc2a16 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:42.942418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-1037f1a5-435a-404a-8da8-0d6ad9dc2a16 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:42.944235 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-1037f1a5-435a-404a-8da8-0d6ad9dc2a16 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:42.945416 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-1037f1a5-435a-404a-8da8-0d6ad9dc2a16 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.192974 Jun 15 14:46:42.946035 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 261/499] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:42 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:46:43.161740 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-bb8d0f9c-d23a-4f02-9bbe-47ba528371ce tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:43.162340 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-bb8d0f9c-d23a-4f02-9bbe-47ba528371ce tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:43.169833 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-bb8d0f9c-d23a-4f02-9bbe-47ba528371ce tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:43.170479 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-bb8d0f9c-d23a-4f02-9bbe-47ba528371ce tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:43.171549 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-bb8d0f9c-d23a-4f02-9bbe-47ba528371ce tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:43.171871 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-bb8d0f9c-d23a-4f02-9bbe-47ba528371ce tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:43.310119 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-bb8d0f9c-d23a-4f02-9bbe-47ba528371ce tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:43.317893 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-bb8d0f9c-d23a-4f02-9bbe-47ba528371ce tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1370 microversion: 2.1 time: 0.159950 Jun 15 14:46:43.318480 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 239/500] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:43 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:43.664352 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-04d880ec-bd4a-4af1-8c47-72afe2c2d178 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:43.665312 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-04d880ec-bd4a-4af1-8c47-72afe2c2d178 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:43.672946 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-04d880ec-bd4a-4af1-8c47-72afe2c2d178 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:43.673399 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-04d880ec-bd4a-4af1-8c47-72afe2c2d178 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:43.674202 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-04d880ec-bd4a-4af1-8c47-72afe2c2d178 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:43.674633 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-04d880ec-bd4a-4af1-8c47-72afe2c2d178 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:43.690267 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=100 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:43.827552 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-04d880ec-bd4a-4af1-8c47-72afe2c2d178 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:43.835512 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-04d880ec-bd4a-4af1-8c47-72afe2c2d178 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1277 microversion: 2.1 time: 0.174971 Jun 15 14:46:43.836632 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 262/501] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:43 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1277 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:43.898029 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-77a18e7f-02d2-4364-8a06-808f6769e0e2 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:43.898648 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-77a18e7f-02d2-4364-8a06-808f6769e0e2 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:43.905310 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-77a18e7f-02d2-4364-8a06-808f6769e0e2 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:43.905798 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-77a18e7f-02d2-4364-8a06-808f6769e0e2 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:43.906562 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-77a18e7f-02d2-4364-8a06-808f6769e0e2 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:43.907001 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-77a18e7f-02d2-4364-8a06-808f6769e0e2 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:43.964326 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c9ef7a52-951b-4e20-af42-79bbceddffe3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:43.966603 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c9ef7a52-951b-4e20-af42-79bbceddffe3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:43.973491 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c9ef7a52-951b-4e20-af42-79bbceddffe3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:43.974223 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c9ef7a52-951b-4e20-af42-79bbceddffe3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:43.975347 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c9ef7a52-951b-4e20-af42-79bbceddffe3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:43.976565 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c9ef7a52-951b-4e20-af42-79bbceddffe3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:44.073002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-77a18e7f-02d2-4364-8a06-808f6769e0e2 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:44.082839 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-77a18e7f-02d2-4364-8a06-808f6769e0e2 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1758 microversion: 2.1 time: 0.188616 Jun 15 14:46:44.083501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 240/502] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:43 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1758 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:44.121290 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c9ef7a52-951b-4e20-af42-79bbceddffe3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:44.136153 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c9ef7a52-951b-4e20-af42-79bbceddffe3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:44.138622 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c9ef7a52-951b-4e20-af42-79bbceddffe3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:44.140181 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-c9ef7a52-951b-4e20-af42-79bbceddffe3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.179709 Jun 15 14:46:44.147887 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 263/503] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:43 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:44.337092 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-f66f2e76-057d-4c12-962b-4c924cb898a5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:44.337854 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-f66f2e76-057d-4c12-962b-4c924cb898a5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:44.345614 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f66f2e76-057d-4c12-962b-4c924cb898a5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:44.346102 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f66f2e76-057d-4c12-962b-4c924cb898a5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:44.346869 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f66f2e76-057d-4c12-962b-4c924cb898a5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:44.347302 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f66f2e76-057d-4c12-962b-4c924cb898a5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:44.487438 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-f66f2e76-057d-4c12-962b-4c924cb898a5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:44.495061 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-f66f2e76-057d-4c12-962b-4c924cb898a5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1370 microversion: 2.1 time: 0.162537 Jun 15 14:46:44.495619 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 241/504] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:44 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:44.853799 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-1ac29225-79c8-460c-807d-9f7a1412b83c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:44.854514 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-1ac29225-79c8-460c-807d-9f7a1412b83c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:44.862237 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1ac29225-79c8-460c-807d-9f7a1412b83c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:44.862767 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1ac29225-79c8-460c-807d-9f7a1412b83c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:44.863492 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1ac29225-79c8-460c-807d-9f7a1412b83c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:44.863935 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1ac29225-79c8-460c-807d-9f7a1412b83c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:45.000457 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-1ac29225-79c8-460c-807d-9f7a1412b83c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:45.007974 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-1ac29225-79c8-460c-807d-9f7a1412b83c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1277 microversion: 2.1 time: 0.158218 Jun 15 14:46:45.008535 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 264/505] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:44 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:45.100321 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-41457693-2b28-4f11-a1d2-33ed997158b6 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:45.100970 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-41457693-2b28-4f11-a1d2-33ed997158b6 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:45.107901 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-41457693-2b28-4f11-a1d2-33ed997158b6 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:45.108344 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-41457693-2b28-4f11-a1d2-33ed997158b6 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:45.109102 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-41457693-2b28-4f11-a1d2-33ed997158b6 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:45.109534 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-41457693-2b28-4f11-a1d2-33ed997158b6 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:45.160433 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-a22dbb70-8d14-4203-aad1-f6448f06fcaa tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:45.161314 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-a22dbb70-8d14-4203-aad1-f6448f06fcaa tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:45.167866 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a22dbb70-8d14-4203-aad1-f6448f06fcaa tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:45.170651 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a22dbb70-8d14-4203-aad1-f6448f06fcaa tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:45.172383 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a22dbb70-8d14-4203-aad1-f6448f06fcaa tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:45.173163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a22dbb70-8d14-4203-aad1-f6448f06fcaa tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:45.341391 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-a22dbb70-8d14-4203-aad1-f6448f06fcaa tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:45.353754 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-a22dbb70-8d14-4203-aad1-f6448f06fcaa tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:45.358673 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-a22dbb70-8d14-4203-aad1-f6448f06fcaa tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:45.359911 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-a22dbb70-8d14-4203-aad1-f6448f06fcaa tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.203509 Jun 15 14:46:45.370455 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 265/506] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:45 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:45.522515 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-41457693-2b28-4f11-a1d2-33ed997158b6 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:45.526251 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c2e40ad6-cb2b-497c-a4dd-4c64fec050a7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:45.530170 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c2e40ad6-cb2b-497c-a4dd-4c64fec050a7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:45.537584 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-41457693-2b28-4f11-a1d2-33ed997158b6 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1758 microversion: 2.1 time: 0.441076 Jun 15 14:46:45.539345 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c2e40ad6-cb2b-497c-a4dd-4c64fec050a7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:45.539783 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c2e40ad6-cb2b-497c-a4dd-4c64fec050a7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:45.540591 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c2e40ad6-cb2b-497c-a4dd-4c64fec050a7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:45.540972 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c2e40ad6-cb2b-497c-a4dd-4c64fec050a7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:45.552706 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 242/507] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:45 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1758 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:45.692495 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c2e40ad6-cb2b-497c-a4dd-4c64fec050a7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:45.701280 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-c2e40ad6-cb2b-497c-a4dd-4c64fec050a7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1370 microversion: 2.1 time: 0.190896 Jun 15 14:46:45.701908 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 266/508] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:45 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:46.024780 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-54f43219-30c3-47cc-a4c9-83ba86240d63 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:46.025390 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-54f43219-30c3-47cc-a4c9-83ba86240d63 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:46.032851 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-54f43219-30c3-47cc-a4c9-83ba86240d63 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:46.033226 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-54f43219-30c3-47cc-a4c9-83ba86240d63 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:46.034033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-54f43219-30c3-47cc-a4c9-83ba86240d63 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:46.034469 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-54f43219-30c3-47cc-a4c9-83ba86240d63 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:46.182694 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-54f43219-30c3-47cc-a4c9-83ba86240d63 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:46.190931 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-54f43219-30c3-47cc-a4c9-83ba86240d63 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1277 microversion: 2.1 time: 0.170255 Jun 15 14:46:46.191495 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 243/509] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:46 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:46.378600 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-8759e629-3a3d-41d5-9934-d3e0055ac8f8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:46.379141 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-8759e629-3a3d-41d5-9934-d3e0055ac8f8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:46.388728 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8759e629-3a3d-41d5-9934-d3e0055ac8f8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:46.389175 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8759e629-3a3d-41d5-9934-d3e0055ac8f8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:46.390151 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8759e629-3a3d-41d5-9934-d3e0055ac8f8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:46.390730 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8759e629-3a3d-41d5-9934-d3e0055ac8f8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:46.527886 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-8759e629-3a3d-41d5-9934-d3e0055ac8f8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:46.536399 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-8759e629-3a3d-41d5-9934-d3e0055ac8f8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:46.537941 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-8759e629-3a3d-41d5-9934-d3e0055ac8f8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:46.539104 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-8759e629-3a3d-41d5-9934-d3e0055ac8f8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.164680 Jun 15 14:46:46.539679 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 267/510] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:46 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:46.563222 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6b5405a4-16c0-49b9-8247-cbabdbe38ed7 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:46.564027 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6b5405a4-16c0-49b9-8247-cbabdbe38ed7 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:46.570667 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6b5405a4-16c0-49b9-8247-cbabdbe38ed7 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:46.571113 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6b5405a4-16c0-49b9-8247-cbabdbe38ed7 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:46.571885 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6b5405a4-16c0-49b9-8247-cbabdbe38ed7 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:46.572314 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6b5405a4-16c0-49b9-8247-cbabdbe38ed7 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:46.719281 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-d81a5542-6396-486c-b7a3-03efbde9c414 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:46.719892 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-d81a5542-6396-486c-b7a3-03efbde9c414 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:46.726150 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d81a5542-6396-486c-b7a3-03efbde9c414 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:46.726596 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d81a5542-6396-486c-b7a3-03efbde9c414 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:46.727360 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d81a5542-6396-486c-b7a3-03efbde9c414 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:46.727794 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d81a5542-6396-486c-b7a3-03efbde9c414 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:46.737399 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6b5405a4-16c0-49b9-8247-cbabdbe38ed7 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:46.745410 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-6b5405a4-16c0-49b9-8247-cbabdbe38ed7 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1758 microversion: 2.1 time: 0.186819 Jun 15 14:46:46.746275 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 244/511] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:46 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1758 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:46.891433 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d81a5542-6396-486c-b7a3-03efbde9c414 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:46.899008 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-d81a5542-6396-486c-b7a3-03efbde9c414 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1370 microversion: 2.1 time: 0.184436 Jun 15 14:46:46.899728 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 268/512] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:46 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:47.208268 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-8fcbed19-c4fb-4a44-a747-124fb53605f5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:47.208979 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-8fcbed19-c4fb-4a44-a747-124fb53605f5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:47.215468 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8fcbed19-c4fb-4a44-a747-124fb53605f5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:47.216362 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8fcbed19-c4fb-4a44-a747-124fb53605f5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:47.217807 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8fcbed19-c4fb-4a44-a747-124fb53605f5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:47.218315 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8fcbed19-c4fb-4a44-a747-124fb53605f5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:47.350982 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-8fcbed19-c4fb-4a44-a747-124fb53605f5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:47.359893 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-8fcbed19-c4fb-4a44-a747-124fb53605f5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1277 microversion: 2.1 time: 0.155435 Jun 15 14:46:47.360631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 245/513] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:47 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:47.556710 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-b6107bed-a4c0-480d-ba10-e40e874a910b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:47.557318 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-b6107bed-a4c0-480d-ba10-e40e874a910b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:47.565068 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b6107bed-a4c0-480d-ba10-e40e874a910b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:47.565513 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b6107bed-a4c0-480d-ba10-e40e874a910b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:47.566391 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b6107bed-a4c0-480d-ba10-e40e874a910b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:47.566818 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b6107bed-a4c0-480d-ba10-e40e874a910b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:47.704522 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b6107bed-a4c0-480d-ba10-e40e874a910b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:47.712959 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b6107bed-a4c0-480d-ba10-e40e874a910b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:47.714497 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b6107bed-a4c0-480d-ba10-e40e874a910b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:47.715680 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-b6107bed-a4c0-480d-ba10-e40e874a910b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.163161 Jun 15 14:46:47.716487 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 269/514] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:47 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:47.762278 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-9fce5899-03d9-494b-830e-e960c5f422ea tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:47.763009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-9fce5899-03d9-494b-830e-e960c5f422ea tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:47.765845 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=2 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:47.771727 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9fce5899-03d9-494b-830e-e960c5f422ea tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:47.772176 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9fce5899-03d9-494b-830e-e960c5f422ea tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:47.772952 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9fce5899-03d9-494b-830e-e960c5f422ea tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:47.773449 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9fce5899-03d9-494b-830e-e960c5f422ea tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:47.825459 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=8 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:47.917504 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-8f6357be-4a73-4560-941f-93c53914f22d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:47.918313 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-8f6357be-4a73-4560-941f-93c53914f22d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:47.925467 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8f6357be-4a73-4560-941f-93c53914f22d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:47.926044 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8f6357be-4a73-4560-941f-93c53914f22d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:47.926731 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8f6357be-4a73-4560-941f-93c53914f22d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:47.927173 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8f6357be-4a73-4560-941f-93c53914f22d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:47.938519 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9fce5899-03d9-494b-830e-e960c5f422ea tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:47.948106 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-9fce5899-03d9-494b-830e-e960c5f422ea tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1758 microversion: 2.1 time: 0.189653 Jun 15 14:46:47.948681 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 246/515] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:47 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1758 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:48.091703 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-8f6357be-4a73-4560-941f-93c53914f22d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:48.099787 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-8f6357be-4a73-4560-941f-93c53914f22d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1370 microversion: 2.1 time: 0.186054 Jun 15 14:46:48.100487 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 270/516] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:47 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:48.378971 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-472a9575-7805-4efa-a652-c0f791b2444e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:48.380307 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-472a9575-7805-4efa-a652-c0f791b2444e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:48.390886 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-472a9575-7805-4efa-a652-c0f791b2444e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:48.391691 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-472a9575-7805-4efa-a652-c0f791b2444e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:48.392503 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-472a9575-7805-4efa-a652-c0f791b2444e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:48.392933 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-472a9575-7805-4efa-a652-c0f791b2444e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:48.531316 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-472a9575-7805-4efa-a652-c0f791b2444e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:48.538857 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-472a9575-7805-4efa-a652-c0f791b2444e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1277 microversion: 2.1 time: 0.166106 Jun 15 14:46:48.539439 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 247/517] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:48 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:48.735608 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-1e12e24d-48f2-4e0c-acda-a7c5867e7067 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:48.736272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-1e12e24d-48f2-4e0c-acda-a7c5867e7067 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:48.743091 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1e12e24d-48f2-4e0c-acda-a7c5867e7067 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:48.743548 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1e12e24d-48f2-4e0c-acda-a7c5867e7067 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:48.744328 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1e12e24d-48f2-4e0c-acda-a7c5867e7067 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:48.745029 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1e12e24d-48f2-4e0c-acda-a7c5867e7067 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:48.892965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-1e12e24d-48f2-4e0c-acda-a7c5867e7067 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:48.902001 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-1e12e24d-48f2-4e0c-acda-a7c5867e7067 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:48.903822 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-1e12e24d-48f2-4e0c-acda-a7c5867e7067 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:48.905889 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-1e12e24d-48f2-4e0c-acda-a7c5867e7067 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.174601 Jun 15 14:46:48.906460 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 271/518] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:48 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:48.967413 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1d7f0d4f-d7df-4614-9d45-0cf3d325c826 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:48.968091 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1d7f0d4f-d7df-4614-9d45-0cf3d325c826 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:48.971313 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:48.975158 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1d7f0d4f-d7df-4614-9d45-0cf3d325c826 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:48.975607 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1d7f0d4f-d7df-4614-9d45-0cf3d325c826 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:48.976367 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1d7f0d4f-d7df-4614-9d45-0cf3d325c826 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:48.976802 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1d7f0d4f-d7df-4614-9d45-0cf3d325c826 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:49.118715 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-bba1b653-4fc1-4a18-a883-24c20bb5d615 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:49.119772 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-bba1b653-4fc1-4a18-a883-24c20bb5d615 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:49.125513 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-1d7f0d4f-d7df-4614-9d45-0cf3d325c826 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:49.127268 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bba1b653-4fc1-4a18-a883-24c20bb5d615 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:49.128070 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bba1b653-4fc1-4a18-a883-24c20bb5d615 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:49.129645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bba1b653-4fc1-4a18-a883-24c20bb5d615 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:49.130283 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bba1b653-4fc1-4a18-a883-24c20bb5d615 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:49.140030 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-1d7f0d4f-d7df-4614-9d45-0cf3d325c826 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1758 microversion: 2.1 time: 0.176747 Jun 15 14:46:49.140620 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 248/519] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:48 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:49.266512 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-bba1b653-4fc1-4a18-a883-24c20bb5d615 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:49.274430 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-bba1b653-4fc1-4a18-a883-24c20bb5d615 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1370 microversion: 2.1 time: 0.159977 Jun 15 14:46:49.275136 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 272/520] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:49 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:49.555914 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-8e4bcdf0-4121-44a8-8f55-7f5810347f94 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:49.557066 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-8e4bcdf0-4121-44a8-8f55-7f5810347f94 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:49.565678 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8e4bcdf0-4121-44a8-8f55-7f5810347f94 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:49.566222 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8e4bcdf0-4121-44a8-8f55-7f5810347f94 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:49.567250 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8e4bcdf0-4121-44a8-8f55-7f5810347f94 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:49.567785 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8e4bcdf0-4121-44a8-8f55-7f5810347f94 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:49.712767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-8e4bcdf0-4121-44a8-8f55-7f5810347f94 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:49.716561 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=100 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:49.722345 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-8e4bcdf0-4121-44a8-8f55-7f5810347f94 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1277 microversion: 2.1 time: 0.170336 Jun 15 14:46:49.722927 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 249/521] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:49 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:49.924295 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-15ce767b-95f2-40d7-8f1b-22b764000bde tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:49.924869 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-15ce767b-95f2-40d7-8f1b-22b764000bde tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:49.931707 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-15ce767b-95f2-40d7-8f1b-22b764000bde tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:49.932257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-15ce767b-95f2-40d7-8f1b-22b764000bde tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:49.933022 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-15ce767b-95f2-40d7-8f1b-22b764000bde tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:49.933462 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-15ce767b-95f2-40d7-8f1b-22b764000bde tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:50.074464 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-15ce767b-95f2-40d7-8f1b-22b764000bde tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:50.084200 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-15ce767b-95f2-40d7-8f1b-22b764000bde tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:50.085768 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-15ce767b-95f2-40d7-8f1b-22b764000bde tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:50.086938 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-15ce767b-95f2-40d7-8f1b-22b764000bde tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.166783 Jun 15 14:46:50.087496 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 273/522] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:49 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:50.158722 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-f99ba82a-1835-4001-a63c-1cee90d6a6c8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:50.159412 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-f99ba82a-1835-4001-a63c-1cee90d6a6c8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:50.166353 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f99ba82a-1835-4001-a63c-1cee90d6a6c8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:50.166955 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f99ba82a-1835-4001-a63c-1cee90d6a6c8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:50.167736 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f99ba82a-1835-4001-a63c-1cee90d6a6c8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:50.168175 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f99ba82a-1835-4001-a63c-1cee90d6a6c8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:50.291263 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-57ef582c-45d5-4aa8-906a-27ec73eeb3de tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:50.291880 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-57ef582c-45d5-4aa8-906a-27ec73eeb3de tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:50.298064 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-57ef582c-45d5-4aa8-906a-27ec73eeb3de tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:50.298517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-57ef582c-45d5-4aa8-906a-27ec73eeb3de tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:50.299278 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-57ef582c-45d5-4aa8-906a-27ec73eeb3de tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:50.299714 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-57ef582c-45d5-4aa8-906a-27ec73eeb3de tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:50.315462 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-f99ba82a-1835-4001-a63c-1cee90d6a6c8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:50.325036 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-f99ba82a-1835-4001-a63c-1cee90d6a6c8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1758 microversion: 2.1 time: 0.171952 Jun 15 14:46:50.325922 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 250/523] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:50 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:50.439569 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-57ef582c-45d5-4aa8-906a-27ec73eeb3de tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:50.461930 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-57ef582c-45d5-4aa8-906a-27ec73eeb3de tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1370 microversion: 2.1 time: 0.174347 Jun 15 14:46:50.462512 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 274/524] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:50 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:50.738956 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-abdceee8-77d8-4c8e-b281-30f8295282f9 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:50.739585 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-abdceee8-77d8-4c8e-b281-30f8295282f9 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:50.746187 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-abdceee8-77d8-4c8e-b281-30f8295282f9 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:50.746640 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-abdceee8-77d8-4c8e-b281-30f8295282f9 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:50.747734 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-abdceee8-77d8-4c8e-b281-30f8295282f9 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:50.748792 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-abdceee8-77d8-4c8e-b281-30f8295282f9 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:50.888757 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-abdceee8-77d8-4c8e-b281-30f8295282f9 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:50.896414 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-abdceee8-77d8-4c8e-b281-30f8295282f9 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1277 microversion: 2.1 time: 0.161336 Jun 15 14:46:50.896978 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 251/525] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:50 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:51.105414 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0b84899d-c815-43f4-9468-d68a159c870e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:51.106049 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-0b84899d-c815-43f4-9468-d68a159c870e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:51.113089 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0b84899d-c815-43f4-9468-d68a159c870e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:51.113535 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0b84899d-c815-43f4-9468-d68a159c870e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:51.114311 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0b84899d-c815-43f4-9468-d68a159c870e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:51.114742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0b84899d-c815-43f4-9468-d68a159c870e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:51.255737 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0b84899d-c815-43f4-9468-d68a159c870e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:51.264112 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0b84899d-c815-43f4-9468-d68a159c870e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:51.265622 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0b84899d-c815-43f4-9468-d68a159c870e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:51.266800 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-0b84899d-c815-43f4-9468-d68a159c870e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.165150 Jun 15 14:46:51.267361 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 275/526] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:51 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:51.345097 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-83d1aec2-c395-42e7-b6aa-deccecbd93b6 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:51.345889 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-83d1aec2-c395-42e7-b6aa-deccecbd93b6 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:51.352909 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-83d1aec2-c395-42e7-b6aa-deccecbd93b6 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:51.353348 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-83d1aec2-c395-42e7-b6aa-deccecbd93b6 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:51.354141 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-83d1aec2-c395-42e7-b6aa-deccecbd93b6 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:51.354570 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-83d1aec2-c395-42e7-b6aa-deccecbd93b6 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:51.478874 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-8b625171-436c-41c0-a158-2c691b796aa0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:51.479489 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-8b625171-436c-41c0-a158-2c691b796aa0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:51.485640 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8b625171-436c-41c0-a158-2c691b796aa0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:51.486123 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8b625171-436c-41c0-a158-2c691b796aa0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:51.486894 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8b625171-436c-41c0-a158-2c691b796aa0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:51.487339 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8b625171-436c-41c0-a158-2c691b796aa0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:51.510650 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-83d1aec2-c395-42e7-b6aa-deccecbd93b6 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:51.519600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-83d1aec2-c395-42e7-b6aa-deccecbd93b6 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1758 microversion: 2.1 time: 0.180513 Jun 15 14:46:51.520376 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 252/527] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:51 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:51.617878 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-8b625171-436c-41c0-a158-2c691b796aa0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:51.625287 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-8b625171-436c-41c0-a158-2c691b796aa0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1370 microversion: 2.1 time: 0.150279 Jun 15 14:46:51.625874 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 276/528] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:51 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:51.913331 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c2ae5b8b-2a51-483f-a616-b6aaa53cf975 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:51.913976 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-c2ae5b8b-2a51-483f-a616-b6aaa53cf975 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:51.919968 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c2ae5b8b-2a51-483f-a616-b6aaa53cf975 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:51.920545 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c2ae5b8b-2a51-483f-a616-b6aaa53cf975 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:51.921302 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c2ae5b8b-2a51-483f-a616-b6aaa53cf975 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:51.921764 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c2ae5b8b-2a51-483f-a616-b6aaa53cf975 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:52.059890 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-c2ae5b8b-2a51-483f-a616-b6aaa53cf975 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:52.068824 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-c2ae5b8b-2a51-483f-a616-b6aaa53cf975 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1277 microversion: 2.1 time: 0.159249 Jun 15 14:46:52.069612 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 253/529] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:51 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:52.284421 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-faf2af12-1299-4747-a7ca-654b5e5be3cb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:52.285027 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-faf2af12-1299-4747-a7ca-654b5e5be3cb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:52.291763 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-faf2af12-1299-4747-a7ca-654b5e5be3cb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:52.292214 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-faf2af12-1299-4747-a7ca-654b5e5be3cb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:52.292971 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-faf2af12-1299-4747-a7ca-654b5e5be3cb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:52.293406 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-faf2af12-1299-4747-a7ca-654b5e5be3cb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:52.431294 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-faf2af12-1299-4747-a7ca-654b5e5be3cb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:52.444267 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-faf2af12-1299-4747-a7ca-654b5e5be3cb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:52.445834 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-faf2af12-1299-4747-a7ca-654b5e5be3cb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:52.447023 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-faf2af12-1299-4747-a7ca-654b5e5be3cb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.166536 Jun 15 14:46:52.447582 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 277/530] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:52 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:52.536694 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-ea697924-c9cc-4ada-9f1e-46d9f909ec57 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:52.537306 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-ea697924-c9cc-4ada-9f1e-46d9f909ec57 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:52.543788 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ea697924-c9cc-4ada-9f1e-46d9f909ec57 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:52.544228 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ea697924-c9cc-4ada-9f1e-46d9f909ec57 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:52.544987 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ea697924-c9cc-4ada-9f1e-46d9f909ec57 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:52.546150 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ea697924-c9cc-4ada-9f1e-46d9f909ec57 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:52.642486 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f8eaf234-fe44-4383-a717-2b749e615084 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:52.643101 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f8eaf234-fe44-4383-a717-2b749e615084 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:52.649162 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f8eaf234-fe44-4383-a717-2b749e615084 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:52.649601 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f8eaf234-fe44-4383-a717-2b749e615084 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:52.650429 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f8eaf234-fe44-4383-a717-2b749e615084 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:52.650864 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f8eaf234-fe44-4383-a717-2b749e615084 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:52.697123 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ea697924-c9cc-4ada-9f1e-46d9f909ec57 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:52.706394 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-ea697924-c9cc-4ada-9f1e-46d9f909ec57 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1758 microversion: 2.1 time: 0.173503 Jun 15 14:46:52.707075 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 254/531] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:52 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:52.800433 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f8eaf234-fe44-4383-a717-2b749e615084 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:52.808706 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f8eaf234-fe44-4383-a717-2b749e615084 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1370 microversion: 2.1 time: 0.170603 Jun 15 14:46:52.809290 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 278/532] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:52 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:53.086289 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-ab1d6ff8-98ae-4836-bfa7-fd423345c991 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:53.086969 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-ab1d6ff8-98ae-4836-bfa7-fd423345c991 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:53.094502 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ab1d6ff8-98ae-4836-bfa7-fd423345c991 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:53.095103 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ab1d6ff8-98ae-4836-bfa7-fd423345c991 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:53.095905 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ab1d6ff8-98ae-4836-bfa7-fd423345c991 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:53.096460 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ab1d6ff8-98ae-4836-bfa7-fd423345c991 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:53.238484 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e47792b2-ab18-44cf-a712-bc7f336ccc53 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-380622131", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-669145631", "security_groups": [{"name": "tempest-secgroup-smoke-387789690"}], "networks": [{"uuid": "6bc92948-344c-4ee0-ac69-1fe29fa99dcb"}], "block_device_mapping_v2": [{"uuid": "6aa4bd29-5782-46fe-9e84-eeda56df3464", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:46:53.245293 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ab1d6ff8-98ae-4836-bfa7-fd423345c991 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:53.253167 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-ab1d6ff8-98ae-4836-bfa7-fd423345c991 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1277 microversion: 2.1 time: 0.170803 Jun 15 14:46:53.253947 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 255/533] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:53 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:53.351866 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.network.neutron [None req-e47792b2-ab18-44cf-a712-bc7f336ccc53 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] validate_networks() for [('6bc92948-344c-4ee0-ac69-1fe29fa99dcb', None, None, None, None, None)] {{(pid=124219) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:46:53.465567 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-0fda4f67-59b0-4893-b59a-afefd5259df2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:53.466453 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-0fda4f67-59b0-4893-b59a-afefd5259df2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:53.473536 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0fda4f67-59b0-4893-b59a-afefd5259df2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:53.474011 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0fda4f67-59b0-4893-b59a-afefd5259df2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:53.474766 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0fda4f67-59b0-4893-b59a-afefd5259df2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:53.475200 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0fda4f67-59b0-4893-b59a-afefd5259df2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:53.539548 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=100 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:53.642049 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-0fda4f67-59b0-4893-b59a-afefd5259df2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:53.650905 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-0fda4f67-59b0-4893-b59a-afefd5259df2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:53.652782 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-0fda4f67-59b0-4893-b59a-afefd5259df2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:53.660602 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-0fda4f67-59b0-4893-b59a-afefd5259df2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.198812 Jun 15 14:46:53.661366 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 256/534] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:53 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:46:53.724280 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a4c12e6d-4911-47df-be5a-ea6ab7eb6a8b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:53.725153 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a4c12e6d-4911-47df-be5a-ea6ab7eb6a8b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:53.733865 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a4c12e6d-4911-47df-be5a-ea6ab7eb6a8b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:53.734410 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a4c12e6d-4911-47df-be5a-ea6ab7eb6a8b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:53.735967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a4c12e6d-4911-47df-be5a-ea6ab7eb6a8b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:53.736520 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a4c12e6d-4911-47df-be5a-ea6ab7eb6a8b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:53.766246 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-e47792b2-ab18-44cf-a712-bc7f336ccc53 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Flavor limits 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:46:53.766774 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-e47792b2-ab18-44cf-a712-bc7f336ccc53 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Image limits 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:46:53.767421 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-e47792b2-ab18-44cf-a712-bc7f336ccc53 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Flavor pref 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:46:53.767900 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-e47792b2-ab18-44cf-a712-bc7f336ccc53 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Image pref 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:46:53.768386 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-e47792b2-ab18-44cf-a712-bc7f336ccc53 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:46:53.777957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e47792b2-ab18-44cf-a712-bc7f336ccc53 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:53.778434 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e47792b2-ab18-44cf-a712-bc7f336ccc53 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:53.779338 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e47792b2-ab18-44cf-a712-bc7f336ccc53 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:53.780995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e47792b2-ab18-44cf-a712-bc7f336ccc53 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:53.788577 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=100 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:53.802657 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-e47792b2-ab18-44cf-a712-bc7f336ccc53 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Getting quotas for project 79a3fa88f5ea4fa2940733b09cbc835a. Resources: {'cores', 'instances', 'ram'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:46:53.806975 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-e47792b2-ab18-44cf-a712-bc7f336ccc53 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Getting quotas for user af5c10fc72dc44e59030216239fc678d and project 79a3fa88f5ea4fa2940733b09cbc835a. Resources: {'cores', 'instances', 'ram'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:46:53.890813 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-e47792b2-ab18-44cf-a712-bc7f336ccc53 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Going to run 1 instances... {{(pid=124219) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:46:53.892735 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a4c12e6d-4911-47df-be5a-ea6ab7eb6a8b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:53.892891 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-e47792b2-ab18-44cf-a712-bc7f336ccc53 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6aa4bd29-5782-46fe-9e84-eeda56df3464',volume_size=None,volume_type=None)] {{(pid=124219) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:46:53.900830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a4c12e6d-4911-47df-be5a-ea6ab7eb6a8b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1758 microversion: 2.1 time: 0.180311 Jun 15 14:46:53.901535 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 257/535] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:53 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:53.906077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-40bd1b27-bda0-4c4f-b7d0-447b39d99786 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:53.906676 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-40bd1b27-bda0-4c4f-b7d0-447b39d99786 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:53.914489 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-40bd1b27-bda0-4c4f-b7d0-447b39d99786 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:53.915006 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-40bd1b27-bda0-4c4f-b7d0-447b39d99786 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:53.915867 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-40bd1b27-bda0-4c4f-b7d0-447b39d99786 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:53.916381 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-40bd1b27-bda0-4c4f-b7d0-447b39d99786 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:54.026391 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-e47792b2-ab18-44cf-a712-bc7f336ccc53 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.791700 Jun 15 14:46:54.032356 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 279/536] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 14:46:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:46:54.037058 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f320f408-5ecd-4676-82a6-57d0f3b40082 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:54.037727 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f320f408-5ecd-4676-82a6-57d0f3b40082 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:54.077711 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-40bd1b27-bda0-4c4f-b7d0-447b39d99786 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:54.089590 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-40bd1b27-bda0-4c4f-b7d0-447b39d99786 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1370 microversion: 2.1 time: 0.187120 Jun 15 14:46:54.090579 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 258/537] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:53 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:54.097470 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f320f408-5ecd-4676-82a6-57d0f3b40082 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:54.104818 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f320f408-5ecd-4676-82a6-57d0f3b40082 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1087 microversion: 2.1 time: 0.071356 Jun 15 14:46:54.115424 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 280/538] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:54 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1087 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:54.269445 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-13342832-6195-49cf-8bd6-015d8fc8d746 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:54.274275 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-13342832-6195-49cf-8bd6-015d8fc8d746 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:54.281200 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-13342832-6195-49cf-8bd6-015d8fc8d746 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:54.281652 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-13342832-6195-49cf-8bd6-015d8fc8d746 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:54.282449 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-13342832-6195-49cf-8bd6-015d8fc8d746 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:54.282949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-13342832-6195-49cf-8bd6-015d8fc8d746 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:54.452753 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-13342832-6195-49cf-8bd6-015d8fc8d746 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:54.489223 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-13342832-6195-49cf-8bd6-015d8fc8d746 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1277 microversion: 2.1 time: 0.223209 Jun 15 14:46:54.504883 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 259/539] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:54 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1277 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:54.680726 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-41f15dca-d4df-4aae-9189-fd60b3b6a8db tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:54.681381 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-41f15dca-d4df-4aae-9189-fd60b3b6a8db tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:54.688685 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-41f15dca-d4df-4aae-9189-fd60b3b6a8db tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:54.689139 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-41f15dca-d4df-4aae-9189-fd60b3b6a8db tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:54.689963 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-41f15dca-d4df-4aae-9189-fd60b3b6a8db tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:54.690400 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-41f15dca-d4df-4aae-9189-fd60b3b6a8db tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:54.826569 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-41f15dca-d4df-4aae-9189-fd60b3b6a8db tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:54.835385 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-41f15dca-d4df-4aae-9189-fd60b3b6a8db tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:54.836914 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-41f15dca-d4df-4aae-9189-fd60b3b6a8db tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:54.838114 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-41f15dca-d4df-4aae-9189-fd60b3b6a8db tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.161605 Jun 15 14:46:54.838673 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 281/540] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:54 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:54.918301 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-823f770b-9c9c-4469-812e-9a69671fddc7 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:54.918902 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-823f770b-9c9c-4469-812e-9a69671fddc7 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:54.926155 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-823f770b-9c9c-4469-812e-9a69671fddc7 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:54.926886 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-823f770b-9c9c-4469-812e-9a69671fddc7 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:54.927650 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-823f770b-9c9c-4469-812e-9a69671fddc7 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:54.928102 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-823f770b-9c9c-4469-812e-9a69671fddc7 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:55.075515 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-823f770b-9c9c-4469-812e-9a69671fddc7 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:55.084587 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-823f770b-9c9c-4469-812e-9a69671fddc7 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1758 microversion: 2.1 time: 0.170300 Jun 15 14:46:55.085151 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 260/541] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:54 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:55.108543 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3a8d7ce4-b5d8-45c5-80c5-46d267d26143 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:55.109150 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-3a8d7ce4-b5d8-45c5-80c5-46d267d26143 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:55.115191 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3a8d7ce4-b5d8-45c5-80c5-46d267d26143 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:55.115704 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3a8d7ce4-b5d8-45c5-80c5-46d267d26143 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:55.116467 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3a8d7ce4-b5d8-45c5-80c5-46d267d26143 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:55.116937 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3a8d7ce4-b5d8-45c5-80c5-46d267d26143 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:55.122796 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-b112a247-898b-4410-aa71-0505254e7f2f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:55.123673 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-b112a247-898b-4410-aa71-0505254e7f2f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:55.132413 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b112a247-898b-4410-aa71-0505254e7f2f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:55.133105 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b112a247-898b-4410-aa71-0505254e7f2f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:55.133909 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b112a247-898b-4410-aa71-0505254e7f2f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:55.134344 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b112a247-898b-4410-aa71-0505254e7f2f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:55.199576 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-b112a247-898b-4410-aa71-0505254e7f2f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:55.207918 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-b112a247-898b-4410-aa71-0505254e7f2f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1137 microversion: 2.1 time: 0.089308 Jun 15 14:46:55.208801 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 261/542] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:55 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1137 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:55.248456 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-3a8d7ce4-b5d8-45c5-80c5-46d267d26143 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:55.255931 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-3a8d7ce4-b5d8-45c5-80c5-46d267d26143 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1370 microversion: 2.1 time: 0.151679 Jun 15 14:46:55.256490 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 282/543] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:55 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:55.517132 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-ce31b976-fd7a-4d6d-92c3-b9d4980193b8 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:55.517754 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-ce31b976-fd7a-4d6d-92c3-b9d4980193b8 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:55.523864 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ce31b976-fd7a-4d6d-92c3-b9d4980193b8 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:55.524315 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ce31b976-fd7a-4d6d-92c3-b9d4980193b8 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:55.525077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ce31b976-fd7a-4d6d-92c3-b9d4980193b8 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:55.525518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ce31b976-fd7a-4d6d-92c3-b9d4980193b8 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:55.653389 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ce31b976-fd7a-4d6d-92c3-b9d4980193b8 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:55.661288 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-ce31b976-fd7a-4d6d-92c3-b9d4980193b8 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1277 microversion: 2.1 time: 0.148736 Jun 15 14:46:55.661888 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 262/544] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:55 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1277 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:55.858238 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-dd6a738e-b3d9-424c-aec8-ed2f3ac91f41 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:55.859333 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-dd6a738e-b3d9-424c-aec8-ed2f3ac91f41 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:55.865645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-dd6a738e-b3d9-424c-aec8-ed2f3ac91f41 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:55.866132 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-dd6a738e-b3d9-424c-aec8-ed2f3ac91f41 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:55.866900 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-dd6a738e-b3d9-424c-aec8-ed2f3ac91f41 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:55.867335 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-dd6a738e-b3d9-424c-aec8-ed2f3ac91f41 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:56.001158 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-dd6a738e-b3d9-424c-aec8-ed2f3ac91f41 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:56.009485 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-dd6a738e-b3d9-424c-aec8-ed2f3ac91f41 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:56.011047 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-dd6a738e-b3d9-424c-aec8-ed2f3ac91f41 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:56.012199 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-dd6a738e-b3d9-424c-aec8-ed2f3ac91f41 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.158914 Jun 15 14:46:56.012757 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 283/545] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:55 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:56.102707 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-3b148e3a-1e31-4d61-887a-0ab737b29fa3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:56.103320 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-3b148e3a-1e31-4d61-887a-0ab737b29fa3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:56.110686 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3b148e3a-1e31-4d61-887a-0ab737b29fa3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:56.111073 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3b148e3a-1e31-4d61-887a-0ab737b29fa3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:56.111838 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3b148e3a-1e31-4d61-887a-0ab737b29fa3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:56.112274 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3b148e3a-1e31-4d61-887a-0ab737b29fa3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:56.226893 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-2ad951f1-9bab-44f0-9364-99dc7511b213 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:56.227702 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-2ad951f1-9bab-44f0-9364-99dc7511b213 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:56.235799 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2ad951f1-9bab-44f0-9364-99dc7511b213 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:56.237060 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2ad951f1-9bab-44f0-9364-99dc7511b213 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:56.243954 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2ad951f1-9bab-44f0-9364-99dc7511b213 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:56.244572 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2ad951f1-9bab-44f0-9364-99dc7511b213 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:56.300800 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-3b148e3a-1e31-4d61-887a-0ab737b29fa3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:56.312258 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-3b148e3a-1e31-4d61-887a-0ab737b29fa3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1758 microversion: 2.1 time: 0.213341 Jun 15 14:46:56.313212 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 263/546] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:56 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1758 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:56.317798 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a437a6d9-6ccf-4919-8051-05641721064c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:56.318480 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a437a6d9-6ccf-4919-8051-05641721064c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:56.325236 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a437a6d9-6ccf-4919-8051-05641721064c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:56.326023 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a437a6d9-6ccf-4919-8051-05641721064c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:56.326977 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a437a6d9-6ccf-4919-8051-05641721064c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:56.327423 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a437a6d9-6ccf-4919-8051-05641721064c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:56.330464 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-2ad951f1-9bab-44f0-9364-99dc7511b213 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:56.338597 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-2ad951f1-9bab-44f0-9364-99dc7511b213 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1129 microversion: 2.1 time: 0.116086 Jun 15 14:46:56.339175 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 284/547] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:56 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1129 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:56.464351 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a437a6d9-6ccf-4919-8051-05641721064c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:56.473080 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a437a6d9-6ccf-4919-8051-05641721064c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1370 microversion: 2.1 time: 0.159028 Jun 15 14:46:56.473638 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 264/548] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:56 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:56.679040 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-d18e35b1-0e3e-48dd-b21c-e93fd8c17a5b tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:56.679564 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-d18e35b1-0e3e-48dd-b21c-e93fd8c17a5b tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:56.685482 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d18e35b1-0e3e-48dd-b21c-e93fd8c17a5b tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:56.685972 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d18e35b1-0e3e-48dd-b21c-e93fd8c17a5b tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:56.686735 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d18e35b1-0e3e-48dd-b21c-e93fd8c17a5b tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:56.687167 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d18e35b1-0e3e-48dd-b21c-e93fd8c17a5b tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:56.820422 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d18e35b1-0e3e-48dd-b21c-e93fd8c17a5b tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:56.828947 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-d18e35b1-0e3e-48dd-b21c-e93fd8c17a5b tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1265 microversion: 2.1 time: 0.153893 Jun 15 14:46:56.829549 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 285/549] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:56 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:57.030521 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-b1df989b-fae8-437c-afcb-b896a77bbf3f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:57.031029 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-b1df989b-fae8-437c-afcb-b896a77bbf3f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:57.037103 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b1df989b-fae8-437c-afcb-b896a77bbf3f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:57.037559 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b1df989b-fae8-437c-afcb-b896a77bbf3f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:57.038375 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b1df989b-fae8-437c-afcb-b896a77bbf3f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:57.038817 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b1df989b-fae8-437c-afcb-b896a77bbf3f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:57.166925 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-b1df989b-fae8-437c-afcb-b896a77bbf3f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:57.175440 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-b1df989b-fae8-437c-afcb-b896a77bbf3f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:57.177055 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-b1df989b-fae8-437c-afcb-b896a77bbf3f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:57.178149 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-b1df989b-fae8-437c-afcb-b896a77bbf3f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.151714 Jun 15 14:46:57.178707 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 265/550] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:57 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:57.329469 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-1f55da81-c3fe-4b6a-9ec8-0d39f61231e0 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:57.330055 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-1f55da81-c3fe-4b6a-9ec8-0d39f61231e0 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:57.336472 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1f55da81-c3fe-4b6a-9ec8-0d39f61231e0 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:57.336924 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1f55da81-c3fe-4b6a-9ec8-0d39f61231e0 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:57.337710 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1f55da81-c3fe-4b6a-9ec8-0d39f61231e0 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:57.338149 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1f55da81-c3fe-4b6a-9ec8-0d39f61231e0 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:57.356214 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-cb6c9d3a-5874-4da6-8e80-eed9656db218 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:57.356819 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-cb6c9d3a-5874-4da6-8e80-eed9656db218 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:57.363498 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cb6c9d3a-5874-4da6-8e80-eed9656db218 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:57.363954 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cb6c9d3a-5874-4da6-8e80-eed9656db218 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:57.364724 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cb6c9d3a-5874-4da6-8e80-eed9656db218 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:57.365166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cb6c9d3a-5874-4da6-8e80-eed9656db218 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:57.383884 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=100 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:46:57.427028 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-cb6c9d3a-5874-4da6-8e80-eed9656db218 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:57.434533 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-cb6c9d3a-5874-4da6-8e80-eed9656db218 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1185 microversion: 2.1 time: 0.082053 Jun 15 14:46:57.435105 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 266/551] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:57 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:57.482957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-1f55da81-c3fe-4b6a-9ec8-0d39f61231e0 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:57.489217 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1fd2b8e3-28d0-465c-a49e-1876c82b88d1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:57.489880 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1fd2b8e3-28d0-465c-a49e-1876c82b88d1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:57.491068 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-1f55da81-c3fe-4b6a-9ec8-0d39f61231e0 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1761 microversion: 2.1 time: 0.166096 Jun 15 14:46:57.491637 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 286/552] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:57 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1761 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:57.495975 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1fd2b8e3-28d0-465c-a49e-1876c82b88d1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:57.496428 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1fd2b8e3-28d0-465c-a49e-1876c82b88d1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:57.497191 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1fd2b8e3-28d0-465c-a49e-1876c82b88d1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:57.497629 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1fd2b8e3-28d0-465c-a49e-1876c82b88d1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:57.711038 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-1fd2b8e3-28d0-465c-a49e-1876c82b88d1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:57.721938 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-1fd2b8e3-28d0-465c-a49e-1876c82b88d1 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1370 microversion: 2.1 time: 0.236346 Jun 15 14:46:57.722544 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 267/553] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:57 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1370 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:57.846529 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-7977fcdf-5a83-41f9-ba42-3817e14471b8 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:57.847144 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-7977fcdf-5a83-41f9-ba42-3817e14471b8 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:57.853299 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7977fcdf-5a83-41f9-ba42-3817e14471b8 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:57.853718 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7977fcdf-5a83-41f9-ba42-3817e14471b8 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:57.854488 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7977fcdf-5a83-41f9-ba42-3817e14471b8 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:57.854929 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7977fcdf-5a83-41f9-ba42-3817e14471b8 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:57.984715 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-7977fcdf-5a83-41f9-ba42-3817e14471b8 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:57.992088 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-7977fcdf-5a83-41f9-ba42-3817e14471b8 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1265 microversion: 2.1 time: 0.149389 Jun 15 14:46:57.992656 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 287/554] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:57 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:58.196654 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-d9ab5a3c-cd1c-485e-8547-389e64aa1e2d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:58.197186 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-d9ab5a3c-cd1c-485e-8547-389e64aa1e2d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:58.203881 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d9ab5a3c-cd1c-485e-8547-389e64aa1e2d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:58.204325 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d9ab5a3c-cd1c-485e-8547-389e64aa1e2d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:58.205094 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d9ab5a3c-cd1c-485e-8547-389e64aa1e2d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:58.205531 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d9ab5a3c-cd1c-485e-8547-389e64aa1e2d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:58.334681 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-d9ab5a3c-cd1c-485e-8547-389e64aa1e2d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:58.344061 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-d9ab5a3c-cd1c-485e-8547-389e64aa1e2d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:58.345575 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-d9ab5a3c-cd1c-485e-8547-389e64aa1e2d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:58.346787 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-d9ab5a3c-cd1c-485e-8547-389e64aa1e2d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.154311 Jun 15 14:46:58.350926 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 268/555] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:58 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:58.453186 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3c2e0891-0303-4460-9263-1ac9ae704879 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:58.453730 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-3c2e0891-0303-4460-9263-1ac9ae704879 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:58.460210 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3c2e0891-0303-4460-9263-1ac9ae704879 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:58.460652 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3c2e0891-0303-4460-9263-1ac9ae704879 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:58.461404 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3c2e0891-0303-4460-9263-1ac9ae704879 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:58.461866 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3c2e0891-0303-4460-9263-1ac9ae704879 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:58.523173 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-3c2e0891-0303-4460-9263-1ac9ae704879 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:58.531625 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-3c2e0891-0303-4460-9263-1ac9ae704879 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1185 microversion: 2.1 time: 0.083216 Jun 15 14:46:58.532187 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 288/556] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:58 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:58.740116 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-94c7b01f-8ceb-4145-801e-964f403e4f9a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:58.740884 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-94c7b01f-8ceb-4145-801e-964f403e4f9a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:58.746980 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-94c7b01f-8ceb-4145-801e-964f403e4f9a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:58.747523 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-94c7b01f-8ceb-4145-801e-964f403e4f9a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:58.748358 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-94c7b01f-8ceb-4145-801e-964f403e4f9a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:58.748866 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-94c7b01f-8ceb-4145-801e-964f403e4f9a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:58.877722 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-94c7b01f-8ceb-4145-801e-964f403e4f9a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:58.885127 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-94c7b01f-8ceb-4145-801e-964f403e4f9a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1370 microversion: 2.1 time: 0.148949 Jun 15 14:46:58.885704 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 269/557] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:58 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:59.009315 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-67b6bd92-8d9f-4446-a06c-cf1e87088ee7 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:59.009915 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-67b6bd92-8d9f-4446-a06c-cf1e87088ee7 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:59.016629 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-67b6bd92-8d9f-4446-a06c-cf1e87088ee7 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:59.017083 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-67b6bd92-8d9f-4446-a06c-cf1e87088ee7 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:59.017887 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-67b6bd92-8d9f-4446-a06c-cf1e87088ee7 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:59.018331 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-67b6bd92-8d9f-4446-a06c-cf1e87088ee7 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:59.150637 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-67b6bd92-8d9f-4446-a06c-cf1e87088ee7 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:59.157999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-67b6bd92-8d9f-4446-a06c-cf1e87088ee7 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1265 microversion: 2.1 time: 0.152567 Jun 15 14:46:59.158559 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 289/558] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:59 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:46:59.365782 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-573e2e4a-a43b-4ab1-bc56-4486c97ef4ac tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:59.366391 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-573e2e4a-a43b-4ab1-bc56-4486c97ef4ac tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:59.372812 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-573e2e4a-a43b-4ab1-bc56-4486c97ef4ac tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:59.373261 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-573e2e4a-a43b-4ab1-bc56-4486c97ef4ac tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:59.374738 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-573e2e4a-a43b-4ab1-bc56-4486c97ef4ac tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:59.375265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-573e2e4a-a43b-4ab1-bc56-4486c97ef4ac tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:59.549401 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-2c5486a5-1c68-4484-9eeb-b301d2d3aa8e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:59.549949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-573e2e4a-a43b-4ab1-bc56-4486c97ef4ac tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:59.550455 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-2c5486a5-1c68-4484-9eeb-b301d2d3aa8e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:59.556738 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2c5486a5-1c68-4484-9eeb-b301d2d3aa8e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:59.557261 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2c5486a5-1c68-4484-9eeb-b301d2d3aa8e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:59.558242 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2c5486a5-1c68-4484-9eeb-b301d2d3aa8e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:59.558865 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2c5486a5-1c68-4484-9eeb-b301d2d3aa8e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:59.559335 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-573e2e4a-a43b-4ab1-bc56-4486c97ef4ac tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:59.561074 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-573e2e4a-a43b-4ab1-bc56-4486c97ef4ac tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:59.562880 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-573e2e4a-a43b-4ab1-bc56-4486c97ef4ac tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.201025 Jun 15 14:46:59.563595 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 270/559] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:46:59 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:46:59.621838 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-2c5486a5-1c68-4484-9eeb-b301d2d3aa8e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:46:59.629731 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-2c5486a5-1c68-4484-9eeb-b301d2d3aa8e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1203 microversion: 2.1 time: 0.085021 Jun 15 14:46:59.630290 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 290/560] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:59 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1203 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:46:59.902577 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-567ffbf5-dad3-47b8-ba9a-d87656424f28 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:59.903111 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-567ffbf5-dad3-47b8-ba9a-d87656424f28 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:46:59.909869 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-567ffbf5-dad3-47b8-ba9a-d87656424f28 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:59.910324 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-567ffbf5-dad3-47b8-ba9a-d87656424f28 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:59.911080 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-567ffbf5-dad3-47b8-ba9a-d87656424f28 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:59.911518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-567ffbf5-dad3-47b8-ba9a-d87656424f28 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:00.041186 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-567ffbf5-dad3-47b8-ba9a-d87656424f28 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:00.048746 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-567ffbf5-dad3-47b8-ba9a-d87656424f28 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1370 microversion: 2.1 time: 0.150082 Jun 15 14:47:00.049304 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 271/561] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:46:59 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:00.175134 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-afefd346-7503-42c4-bb45-184a60df0c51 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:00.175702 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-afefd346-7503-42c4-bb45-184a60df0c51 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:00.181790 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-afefd346-7503-42c4-bb45-184a60df0c51 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:00.182265 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-afefd346-7503-42c4-bb45-184a60df0c51 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:00.183023 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-afefd346-7503-42c4-bb45-184a60df0c51 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:00.183481 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-afefd346-7503-42c4-bb45-184a60df0c51 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:00.312999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-afefd346-7503-42c4-bb45-184a60df0c51 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:00.320397 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-afefd346-7503-42c4-bb45-184a60df0c51 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1265 microversion: 2.1 time: 0.149372 Jun 15 14:47:00.320956 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 291/562] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:00 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:00.581450 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6c9b70d4-b6b7-42e1-b176-f6a881460bc9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:00.582439 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6c9b70d4-b6b7-42e1-b176-f6a881460bc9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:00.589478 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6c9b70d4-b6b7-42e1-b176-f6a881460bc9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:00.589970 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6c9b70d4-b6b7-42e1-b176-f6a881460bc9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:00.590748 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6c9b70d4-b6b7-42e1-b176-f6a881460bc9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:00.591193 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6c9b70d4-b6b7-42e1-b176-f6a881460bc9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:00.652937 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-09980c96-3881-4867-9e8e-ad413e744a5a tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:00.653555 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-09980c96-3881-4867-9e8e-ad413e744a5a tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:00.671693 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-09980c96-3881-4867-9e8e-ad413e744a5a tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:00.672229 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-09980c96-3881-4867-9e8e-ad413e744a5a tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:00.673773 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-09980c96-3881-4867-9e8e-ad413e744a5a tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:00.674215 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-09980c96-3881-4867-9e8e-ad413e744a5a tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:00.741829 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-09980c96-3881-4867-9e8e-ad413e744a5a tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:00.742144 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6c9b70d4-b6b7-42e1-b176-f6a881460bc9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:00.751828 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6c9b70d4-b6b7-42e1-b176-f6a881460bc9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:00.753316 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-09980c96-3881-4867-9e8e-ad413e744a5a tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1203 microversion: 2.1 time: 0.105053 Jun 15 14:47:00.753452 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6c9b70d4-b6b7-42e1-b176-f6a881460bc9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:00.754905 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 292/563] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:00 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1203 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:00.755034 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-6c9b70d4-b6b7-42e1-b176-f6a881460bc9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.177038 Jun 15 14:47:00.758679 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 272/564] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:00 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:01.066730 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-ca16f130-30b9-4225-9587-07c839b35779 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:01.067378 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-ca16f130-30b9-4225-9587-07c839b35779 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:01.073458 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ca16f130-30b9-4225-9587-07c839b35779 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:01.073937 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ca16f130-30b9-4225-9587-07c839b35779 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:01.074700 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ca16f130-30b9-4225-9587-07c839b35779 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:01.075138 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ca16f130-30b9-4225-9587-07c839b35779 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:01.204618 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-ca16f130-30b9-4225-9587-07c839b35779 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:01.212147 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-ca16f130-30b9-4225-9587-07c839b35779 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1564 microversion: 2.1 time: 0.150540 Jun 15 14:47:01.212706 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 293/565] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:01 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1564 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:01.229377 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-38621c0f-47fa-4bcd-93e3-7b3ed8a55d3e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:01.229966 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-38621c0f-47fa-4bcd-93e3-7b3ed8a55d3e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:01.236940 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-38621c0f-47fa-4bcd-93e3-7b3ed8a55d3e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:01.237384 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-38621c0f-47fa-4bcd-93e3-7b3ed8a55d3e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:01.238161 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-38621c0f-47fa-4bcd-93e3-7b3ed8a55d3e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:01.238596 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-38621c0f-47fa-4bcd-93e3-7b3ed8a55d3e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:01.317720 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-38621c0f-47fa-4bcd-93e3-7b3ed8a55d3e tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092002 Jun 15 14:47:01.318318 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 273/566] 10.222.0.57 () {58 vars in 1274 bytes} [Wed Jun 15 14:47:01 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:47:01.338525 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-462e1890-ff0f-41c3-95ec-8037fa66e5a6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:01.339164 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-462e1890-ff0f-41c3-95ec-8037fa66e5a6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:01.346423 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-462e1890-ff0f-41c3-95ec-8037fa66e5a6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:01.346879 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-462e1890-ff0f-41c3-95ec-8037fa66e5a6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:01.347644 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-462e1890-ff0f-41c3-95ec-8037fa66e5a6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:01.348082 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-462e1890-ff0f-41c3-95ec-8037fa66e5a6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:01.514621 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-462e1890-ff0f-41c3-95ec-8037fa66e5a6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:01.525019 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-462e1890-ff0f-41c3-95ec-8037fa66e5a6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1265 microversion: 2.1 time: 0.190372 Jun 15 14:47:01.526303 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 294/567] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:01 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:01.776376 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e77e2210-5240-42f6-8044-b51540ac3cc2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:01.777049 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-e77e2210-5240-42f6-8044-b51540ac3cc2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:01.777556 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c1d160d7-1fef-439a-9cae-a91b4eb48bc3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:01.778271 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-c1d160d7-1fef-439a-9cae-a91b4eb48bc3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:01.804415 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e77e2210-5240-42f6-8044-b51540ac3cc2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:01.807181 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c1d160d7-1fef-439a-9cae-a91b4eb48bc3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:01.807795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e77e2210-5240-42f6-8044-b51540ac3cc2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:01.808414 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c1d160d7-1fef-439a-9cae-a91b4eb48bc3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:01.811469 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c1d160d7-1fef-439a-9cae-a91b4eb48bc3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:01.811794 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e77e2210-5240-42f6-8044-b51540ac3cc2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:01.813359 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c1d160d7-1fef-439a-9cae-a91b4eb48bc3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:01.813652 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e77e2210-5240-42f6-8044-b51540ac3cc2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:01.934225 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-c1d160d7-1fef-439a-9cae-a91b4eb48bc3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:01.943579 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-c1d160d7-1fef-439a-9cae-a91b4eb48bc3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1203 microversion: 2.1 time: 0.176190 Jun 15 14:47:01.947594 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 274/568] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:01 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1203 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:02.280121 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e77e2210-5240-42f6-8044-b51540ac3cc2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:02.290904 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e77e2210-5240-42f6-8044-b51540ac3cc2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:02.292523 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e77e2210-5240-42f6-8044-b51540ac3cc2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:02.293830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-e77e2210-5240-42f6-8044-b51540ac3cc2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.525109 Jun 15 14:47:02.294599 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 295/569] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:01 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:02.448574 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-e91219d1-0fd4-47dd-949a-998844db1a76 req-2d7250ad-0e8d-43aa-8273-beb7ec18f54b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7677949-b0c4-4f8a-bf16-26a4c639c344", "tag": "faff7f9d-2ca1-439d-8ffd-5a9dad77ee86"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:47:02.468501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-e91219d1-0fd4-47dd-949a-998844db1a76 req-2d7250ad-0e8d-43aa-8273-beb7ec18f54b service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:02.469007 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-e91219d1-0fd4-47dd-949a-998844db1a76 req-2d7250ad-0e8d-43aa-8273-beb7ec18f54b service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:02.480347 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-e91219d1-0fd4-47dd-949a-998844db1a76 req-2d7250ad-0e8d-43aa-8273-beb7ec18f54b service nova] Creating event network-changed:faff7f9d-2ca1-439d-8ffd-5a9dad77ee86 for instance c7677949-b0c4-4f8a-bf16-26a4c639c344 on hv-cinder-84327 Jun 15 14:47:02.486303 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-e91219d1-0fd4-47dd-949a-998844db1a76 req-2d7250ad-0e8d-43aa-8273-beb7ec18f54b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041559 Jun 15 14:47:02.486902 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 275/570] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:47:02.542370 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-2a5e4946-1ad1-4bc8-9ac5-8d211e9f73ed tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:02.542990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-2a5e4946-1ad1-4bc8-9ac5-8d211e9f73ed tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:02.550700 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2a5e4946-1ad1-4bc8-9ac5-8d211e9f73ed tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:02.550828 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2a5e4946-1ad1-4bc8-9ac5-8d211e9f73ed tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:02.551637 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2a5e4946-1ad1-4bc8-9ac5-8d211e9f73ed tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:02.556824 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2a5e4946-1ad1-4bc8-9ac5-8d211e9f73ed tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:02.709401 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-2a5e4946-1ad1-4bc8-9ac5-8d211e9f73ed tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:02.719613 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-2a5e4946-1ad1-4bc8-9ac5-8d211e9f73ed tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1265 microversion: 2.1 time: 0.180781 Jun 15 14:47:02.729789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 296/571] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:02 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:02.961304 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-4d1d2b58-ebb3-4521-b7ce-f4c232a73cec tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:02.962646 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-4d1d2b58-ebb3-4521-b7ce-f4c232a73cec tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:02.970214 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4d1d2b58-ebb3-4521-b7ce-f4c232a73cec tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:02.970924 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4d1d2b58-ebb3-4521-b7ce-f4c232a73cec tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:02.971714 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4d1d2b58-ebb3-4521-b7ce-f4c232a73cec tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:02.972149 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4d1d2b58-ebb3-4521-b7ce-f4c232a73cec tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:03.109038 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-4d1d2b58-ebb3-4521-b7ce-f4c232a73cec tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:03.118701 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-4d1d2b58-ebb3-4521-b7ce-f4c232a73cec tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1270 microversion: 2.1 time: 0.162077 Jun 15 14:47:03.119570 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 276/572] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:02 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:47:03.314687 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-afa76816-300c-4f43-8595-d2eb533800a3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:03.315314 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-afa76816-300c-4f43-8595-d2eb533800a3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:03.321956 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-afa76816-300c-4f43-8595-d2eb533800a3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:03.322633 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-afa76816-300c-4f43-8595-d2eb533800a3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:03.323437 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-afa76816-300c-4f43-8595-d2eb533800a3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:03.323875 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-afa76816-300c-4f43-8595-d2eb533800a3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:03.360186 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=100 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:47:03.595179 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-afa76816-300c-4f43-8595-d2eb533800a3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:03.614988 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-afa76816-300c-4f43-8595-d2eb533800a3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:03.616842 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-afa76816-300c-4f43-8595-d2eb533800a3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:03.618467 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-afa76816-300c-4f43-8595-d2eb533800a3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.309847 Jun 15 14:47:03.619047 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-8d1832a7-1c9a-4138-b1de-15796ec50a14 req-fa1cf217-c5f7-4744-adca-2b367da8647d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fdd6732-ba3a-4243-a57f-7e84f8eea531", "tag": "457c9267-d5cd-492d-9292-3d4518f9d2bb"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:47:03.619685 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 297/573] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:03 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:03.632279 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-8d1832a7-1c9a-4138-b1de-15796ec50a14 req-fa1cf217-c5f7-4744-adca-2b367da8647d service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:03.634097 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-8d1832a7-1c9a-4138-b1de-15796ec50a14 req-fa1cf217-c5f7-4744-adca-2b367da8647d service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:03.664106 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-8d1832a7-1c9a-4138-b1de-15796ec50a14 req-fa1cf217-c5f7-4744-adca-2b367da8647d service nova] Creating event network-changed:457c9267-d5cd-492d-9292-3d4518f9d2bb for instance 3fdd6732-ba3a-4243-a57f-7e84f8eea531 on hv-cinder-84327 Jun 15 14:47:03.669171 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-8d1832a7-1c9a-4138-b1de-15796ec50a14 req-fa1cf217-c5f7-4744-adca-2b367da8647d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053653 Jun 15 14:47:03.670203 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 277/574] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:47:03.737043 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f8bac888-dc57-44f4-86fe-6e8ce29399b5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:03.737675 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f8bac888-dc57-44f4-86fe-6e8ce29399b5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:03.743938 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f8bac888-dc57-44f4-86fe-6e8ce29399b5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:03.744391 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f8bac888-dc57-44f4-86fe-6e8ce29399b5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:03.745174 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f8bac888-dc57-44f4-86fe-6e8ce29399b5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:03.745609 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f8bac888-dc57-44f4-86fe-6e8ce29399b5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:03.789319 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=2 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:47:03.927513 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f8bac888-dc57-44f4-86fe-6e8ce29399b5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:03.934904 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f8bac888-dc57-44f4-86fe-6e8ce29399b5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1265 microversion: 2.1 time: 0.202418 Jun 15 14:47:03.935714 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 298/575] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:03 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:04.139433 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-8741bc85-3903-4ef4-a357-a5c773f24b83 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:04.140590 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-8741bc85-3903-4ef4-a357-a5c773f24b83 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:04.149677 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8741bc85-3903-4ef4-a357-a5c773f24b83 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:04.150137 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8741bc85-3903-4ef4-a357-a5c773f24b83 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:04.150918 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8741bc85-3903-4ef4-a357-a5c773f24b83 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:04.151355 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8741bc85-3903-4ef4-a357-a5c773f24b83 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:04.283756 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-8741bc85-3903-4ef4-a357-a5c773f24b83 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:04.291307 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-8741bc85-3903-4ef4-a357-a5c773f24b83 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1258 microversion: 2.1 time: 0.157216 Jun 15 14:47:04.291880 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 278/576] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:04 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:04.638158 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3849bdbe-b30f-4a92-af46-620975a57394 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:04.638773 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-3849bdbe-b30f-4a92-af46-620975a57394 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:04.640707 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=8 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:47:04.646389 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3849bdbe-b30f-4a92-af46-620975a57394 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:04.646877 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3849bdbe-b30f-4a92-af46-620975a57394 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:04.647641 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3849bdbe-b30f-4a92-af46-620975a57394 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:04.648115 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3849bdbe-b30f-4a92-af46-620975a57394 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:04.784247 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-3849bdbe-b30f-4a92-af46-620975a57394 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:04.792597 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-3849bdbe-b30f-4a92-af46-620975a57394 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:04.794113 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-3849bdbe-b30f-4a92-af46-620975a57394 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:04.795265 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-3849bdbe-b30f-4a92-af46-620975a57394 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.161051 Jun 15 14:47:04.795820 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 299/577] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:04 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:04.951828 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a1c21fc3-d3e0-4c52-8f0d-65b4a13d0236 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:04.952438 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a1c21fc3-d3e0-4c52-8f0d-65b4a13d0236 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:04.959102 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a1c21fc3-d3e0-4c52-8f0d-65b4a13d0236 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:04.959552 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a1c21fc3-d3e0-4c52-8f0d-65b4a13d0236 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:04.960312 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a1c21fc3-d3e0-4c52-8f0d-65b4a13d0236 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:04.960750 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a1c21fc3-d3e0-4c52-8f0d-65b4a13d0236 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:05.308766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0ce45e12-f9d5-44f0-b9a2-5b7f2b0af0c6 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:05.309801 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-0ce45e12-f9d5-44f0-b9a2-5b7f2b0af0c6 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:05.316181 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a1c21fc3-d3e0-4c52-8f0d-65b4a13d0236 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:05.316672 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0ce45e12-f9d5-44f0-b9a2-5b7f2b0af0c6 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:05.317086 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0ce45e12-f9d5-44f0-b9a2-5b7f2b0af0c6 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:05.317890 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0ce45e12-f9d5-44f0-b9a2-5b7f2b0af0c6 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:05.318332 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0ce45e12-f9d5-44f0-b9a2-5b7f2b0af0c6 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:05.323858 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a1c21fc3-d3e0-4c52-8f0d-65b4a13d0236 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1265 microversion: 2.1 time: 0.375825 Jun 15 14:47:05.324430 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 279/578] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:04 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1265 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:05.448593 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0ce45e12-f9d5-44f0-b9a2-5b7f2b0af0c6 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:05.457046 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-0ce45e12-f9d5-44f0-b9a2-5b7f2b0af0c6 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1258 microversion: 2.1 time: 0.152635 Jun 15 14:47:05.457614 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 300/579] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:05 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:47:05.815199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-cd70eab0-57ea-41a5-8652-d23cb3938608 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:05.815820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-cd70eab0-57ea-41a5-8652-d23cb3938608 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:05.822722 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cd70eab0-57ea-41a5-8652-d23cb3938608 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:05.823177 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cd70eab0-57ea-41a5-8652-d23cb3938608 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:05.823945 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cd70eab0-57ea-41a5-8652-d23cb3938608 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:05.824381 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cd70eab0-57ea-41a5-8652-d23cb3938608 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:05.954692 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-cd70eab0-57ea-41a5-8652-d23cb3938608 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:05.963160 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-cd70eab0-57ea-41a5-8652-d23cb3938608 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:05.964895 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-cd70eab0-57ea-41a5-8652-d23cb3938608 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:05.966084 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-cd70eab0-57ea-41a5-8652-d23cb3938608 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.155582 Jun 15 14:47:05.966893 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 280/580] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:05 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:06.341982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c451bfbb-575a-40be-8fd6-44fffe06fdd4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:06.342603 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c451bfbb-575a-40be-8fd6-44fffe06fdd4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:06.351411 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c451bfbb-575a-40be-8fd6-44fffe06fdd4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:06.351868 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c451bfbb-575a-40be-8fd6-44fffe06fdd4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:06.352647 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c451bfbb-575a-40be-8fd6-44fffe06fdd4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:06.353089 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c451bfbb-575a-40be-8fd6-44fffe06fdd4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:06.473298 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a05f245d-d593-41ca-8382-269106d114ae tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:06.474356 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a05f245d-d593-41ca-8382-269106d114ae tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:06.480621 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a05f245d-d593-41ca-8382-269106d114ae tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:06.481067 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a05f245d-d593-41ca-8382-269106d114ae tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:06.481861 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a05f245d-d593-41ca-8382-269106d114ae tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:06.482297 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a05f245d-d593-41ca-8382-269106d114ae tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:06.564372 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c451bfbb-575a-40be-8fd6-44fffe06fdd4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:06.572175 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-c451bfbb-575a-40be-8fd6-44fffe06fdd4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1265 microversion: 2.1 time: 0.234347 Jun 15 14:47:06.581505 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 301/581] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:06 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:06.620607 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a05f245d-d593-41ca-8382-269106d114ae tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:06.628961 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a05f245d-d593-41ca-8382-269106d114ae tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1258 microversion: 2.1 time: 0.159418 Jun 15 14:47:06.629532 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 281/582] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:06 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:47:06.985861 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-a2e72622-a434-42cd-a7cd-6475387eaca9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:06.986501 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-a2e72622-a434-42cd-a7cd-6475387eaca9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:06.992566 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a2e72622-a434-42cd-a7cd-6475387eaca9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:06.993018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a2e72622-a434-42cd-a7cd-6475387eaca9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:06.993815 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a2e72622-a434-42cd-a7cd-6475387eaca9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:06.994254 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a2e72622-a434-42cd-a7cd-6475387eaca9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:07.122903 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-a2e72622-a434-42cd-a7cd-6475387eaca9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:07.132062 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-a2e72622-a434-42cd-a7cd-6475387eaca9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:07.133562 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-a2e72622-a434-42cd-a7cd-6475387eaca9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:07.134741 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-a2e72622-a434-42cd-a7cd-6475387eaca9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.153641 Jun 15 14:47:07.135292 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 302/583] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:06 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:07.589081 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6f3a4198-8a1b-4255-911a-57dd8b1df6a3 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:07.589719 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6f3a4198-8a1b-4255-911a-57dd8b1df6a3 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:07.596541 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6f3a4198-8a1b-4255-911a-57dd8b1df6a3 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:07.596995 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6f3a4198-8a1b-4255-911a-57dd8b1df6a3 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:07.597803 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6f3a4198-8a1b-4255-911a-57dd8b1df6a3 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:07.598243 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6f3a4198-8a1b-4255-911a-57dd8b1df6a3 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:07.646186 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f2c306da-954a-4d9f-ae7b-f9f407707c94 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:07.646793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f2c306da-954a-4d9f-ae7b-f9f407707c94 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:07.653177 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f2c306da-954a-4d9f-ae7b-f9f407707c94 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:07.653622 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f2c306da-954a-4d9f-ae7b-f9f407707c94 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:07.654404 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f2c306da-954a-4d9f-ae7b-f9f407707c94 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:07.654833 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f2c306da-954a-4d9f-ae7b-f9f407707c94 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:07.734979 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6f3a4198-8a1b-4255-911a-57dd8b1df6a3 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:07.742998 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-6f3a4198-8a1b-4255-911a-57dd8b1df6a3 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1265 microversion: 2.1 time: 0.157700 Jun 15 14:47:07.745700 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 282/584] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:07 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:07.790299 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f2c306da-954a-4d9f-ae7b-f9f407707c94 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:07.798503 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f2c306da-954a-4d9f-ae7b-f9f407707c94 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1258 microversion: 2.1 time: 0.156120 Jun 15 14:47:07.799069 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 303/585] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:07 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:47:08.152370 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-75ec0eb5-95df-4adc-ae54-553a56de7df1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:08.152984 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-75ec0eb5-95df-4adc-ae54-553a56de7df1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:08.159821 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-75ec0eb5-95df-4adc-ae54-553a56de7df1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:08.160273 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-75ec0eb5-95df-4adc-ae54-553a56de7df1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:08.161037 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-75ec0eb5-95df-4adc-ae54-553a56de7df1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:08.161479 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-75ec0eb5-95df-4adc-ae54-553a56de7df1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:08.291056 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-75ec0eb5-95df-4adc-ae54-553a56de7df1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:08.299723 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-75ec0eb5-95df-4adc-ae54-553a56de7df1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:08.301224 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-75ec0eb5-95df-4adc-ae54-553a56de7df1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:08.302435 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-75ec0eb5-95df-4adc-ae54-553a56de7df1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.153998 Jun 15 14:47:08.302984 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 283/586] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:08 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:47:08.760399 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-19f3c91d-7707-404a-844a-54682b32ec4d tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:08.760921 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-19f3c91d-7707-404a-844a-54682b32ec4d tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:08.767459 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-19f3c91d-7707-404a-844a-54682b32ec4d tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:08.767903 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-19f3c91d-7707-404a-844a-54682b32ec4d tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:08.768660 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-19f3c91d-7707-404a-844a-54682b32ec4d tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:08.769096 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-19f3c91d-7707-404a-844a-54682b32ec4d tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:08.816195 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-e309f87a-7b1d-42e5-8c24-618d135b0ac5 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:08.816819 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-e309f87a-7b1d-42e5-8c24-618d135b0ac5 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:08.823492 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e309f87a-7b1d-42e5-8c24-618d135b0ac5 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:08.823944 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e309f87a-7b1d-42e5-8c24-618d135b0ac5 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:08.824713 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e309f87a-7b1d-42e5-8c24-618d135b0ac5 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:08.825154 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e309f87a-7b1d-42e5-8c24-618d135b0ac5 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:08.904475 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-19f3c91d-7707-404a-844a-54682b32ec4d tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:08.912680 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-19f3c91d-7707-404a-844a-54682b32ec4d tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1265 microversion: 2.1 time: 0.156208 Jun 15 14:47:08.913253 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 304/587] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:08 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:08.959373 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e309f87a-7b1d-42e5-8c24-618d135b0ac5 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:08.962925 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=100 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:47:08.968005 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-e309f87a-7b1d-42e5-8c24-618d135b0ac5 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1258 microversion: 2.1 time: 0.156349 Jun 15 14:47:08.968560 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 284/588] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:08 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:47:09.322042 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-b1b98f91-896d-4450-86fc-7942faeb4b61 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:09.322673 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-b1b98f91-896d-4450-86fc-7942faeb4b61 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:09.329648 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b1b98f91-896d-4450-86fc-7942faeb4b61 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:09.330119 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b1b98f91-896d-4450-86fc-7942faeb4b61 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:09.330873 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b1b98f91-896d-4450-86fc-7942faeb4b61 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:09.331306 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b1b98f91-896d-4450-86fc-7942faeb4b61 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:09.459311 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b1b98f91-896d-4450-86fc-7942faeb4b61 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:09.467874 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b1b98f91-896d-4450-86fc-7942faeb4b61 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:09.470526 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b1b98f91-896d-4450-86fc-7942faeb4b61 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:09.471690 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-b1b98f91-896d-4450-86fc-7942faeb4b61 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.153554 Jun 15 14:47:09.472221 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 305/589] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:09 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:09.929536 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-43cc3494-cd15-4f41-87e9-5a9a4c5eb7da tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:09.930167 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-43cc3494-cd15-4f41-87e9-5a9a4c5eb7da tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:09.936654 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-43cc3494-cd15-4f41-87e9-5a9a4c5eb7da tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:09.937110 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-43cc3494-cd15-4f41-87e9-5a9a4c5eb7da tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:09.938420 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-43cc3494-cd15-4f41-87e9-5a9a4c5eb7da tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:09.938866 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-43cc3494-cd15-4f41-87e9-5a9a4c5eb7da tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:09.984222 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3bef885e-ffb8-47fc-b50c-b9fd81ddfc00 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:09.985027 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-3bef885e-ffb8-47fc-b50c-b9fd81ddfc00 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:09.991542 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3bef885e-ffb8-47fc-b50c-b9fd81ddfc00 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:09.992019 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3bef885e-ffb8-47fc-b50c-b9fd81ddfc00 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:09.992787 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3bef885e-ffb8-47fc-b50c-b9fd81ddfc00 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:09.993223 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3bef885e-ffb8-47fc-b50c-b9fd81ddfc00 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:10.075976 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-43cc3494-cd15-4f41-87e9-5a9a4c5eb7da tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:10.084484 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-43cc3494-cd15-4f41-87e9-5a9a4c5eb7da tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1265 microversion: 2.1 time: 0.158997 Jun 15 14:47:10.085237 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 285/590] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:09 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:10.137167 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-3bef885e-ffb8-47fc-b50c-b9fd81ddfc00 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:10.145423 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-3bef885e-ffb8-47fc-b50c-b9fd81ddfc00 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1258 microversion: 2.1 time: 0.164958 Jun 15 14:47:10.146021 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 306/591] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:09 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:47:10.164981 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-fec5de43-93f0-4aad-9ffd-af6360e169af req-f5b16fb1-3a47-467e-9908-1df552ca7792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9104e014-d497-460a-8215-6439f0a2e521", "name": "network-vif-plugged", "status": "completed", "tag": "bc9c90a6-a5e4-499e-bc4a-d030962cd9bc"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:47:10.175139 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-fec5de43-93f0-4aad-9ffd-af6360e169af req-f5b16fb1-3a47-467e-9908-1df552ca7792 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:10.175687 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-fec5de43-93f0-4aad-9ffd-af6360e169af req-f5b16fb1-3a47-467e-9908-1df552ca7792 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:10.187293 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-fec5de43-93f0-4aad-9ffd-af6360e169af req-f5b16fb1-3a47-467e-9908-1df552ca7792 service nova] Creating event network-vif-plugged:bc9c90a6-a5e4-499e-bc4a-d030962cd9bc for instance 9104e014-d497-460a-8215-6439f0a2e521 on hv-cinder-84327 Jun 15 14:47:10.192898 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-fec5de43-93f0-4aad-9ffd-af6360e169af req-f5b16fb1-3a47-467e-9908-1df552ca7792 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031596 Jun 15 14:47:10.193551 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 286/592] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:47:10.489692 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-09b4d5bd-98c8-4ae7-b86c-831d2de5f9fa tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:10.490296 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-09b4d5bd-98c8-4ae7-b86c-831d2de5f9fa tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:10.496683 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-09b4d5bd-98c8-4ae7-b86c-831d2de5f9fa tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:10.497139 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-09b4d5bd-98c8-4ae7-b86c-831d2de5f9fa tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:10.497949 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-09b4d5bd-98c8-4ae7-b86c-831d2de5f9fa tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:10.498394 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-09b4d5bd-98c8-4ae7-b86c-831d2de5f9fa tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:10.673022 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-09b4d5bd-98c8-4ae7-b86c-831d2de5f9fa tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:10.681817 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-09b4d5bd-98c8-4ae7-b86c-831d2de5f9fa tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:10.683328 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-09b4d5bd-98c8-4ae7-b86c-831d2de5f9fa tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:10.684488 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-09b4d5bd-98c8-4ae7-b86c-831d2de5f9fa tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.198784 Jun 15 14:47:10.685045 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 307/593] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:10 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:11.102982 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-f672acea-9a33-408b-85f3-2415d56459f1 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:11.103674 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-f672acea-9a33-408b-85f3-2415d56459f1 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:11.110394 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f672acea-9a33-408b-85f3-2415d56459f1 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:11.111465 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f672acea-9a33-408b-85f3-2415d56459f1 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:11.112218 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f672acea-9a33-408b-85f3-2415d56459f1 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:11.112653 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f672acea-9a33-408b-85f3-2415d56459f1 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:11.162806 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-9c223e1e-905c-4338-8878-2d76402f026c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:11.163420 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-9c223e1e-905c-4338-8878-2d76402f026c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:11.169926 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9c223e1e-905c-4338-8878-2d76402f026c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:11.170376 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9c223e1e-905c-4338-8878-2d76402f026c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:11.171134 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9c223e1e-905c-4338-8878-2d76402f026c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:11.171568 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9c223e1e-905c-4338-8878-2d76402f026c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:11.248626 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-f672acea-9a33-408b-85f3-2415d56459f1 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:11.256515 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-f672acea-9a33-408b-85f3-2415d56459f1 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1265 microversion: 2.1 time: 0.158121 Jun 15 14:47:11.257174 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 287/594] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:11 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:11.316603 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-9c223e1e-905c-4338-8878-2d76402f026c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:11.324102 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-9c223e1e-905c-4338-8878-2d76402f026c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1258 microversion: 2.1 time: 0.165138 Jun 15 14:47:11.324659 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 308/595] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:11 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:47:11.702534 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-d0dadf09-9ac7-4b19-9381-0d8c48999b3c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:11.703147 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-d0dadf09-9ac7-4b19-9381-0d8c48999b3c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:11.709930 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d0dadf09-9ac7-4b19-9381-0d8c48999b3c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:11.710329 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d0dadf09-9ac7-4b19-9381-0d8c48999b3c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:11.711119 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d0dadf09-9ac7-4b19-9381-0d8c48999b3c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:11.711554 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d0dadf09-9ac7-4b19-9381-0d8c48999b3c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:11.839498 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-d0dadf09-9ac7-4b19-9381-0d8c48999b3c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:11.848996 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-d0dadf09-9ac7-4b19-9381-0d8c48999b3c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:11.850526 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-d0dadf09-9ac7-4b19-9381-0d8c48999b3c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:11.851667 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-d0dadf09-9ac7-4b19-9381-0d8c48999b3c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.153039 Jun 15 14:47:11.852216 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 288/596] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:11 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:12.273587 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0014d605-a08e-4889-acf7-f5a7b52cb0d9 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:12.274162 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-0014d605-a08e-4889-acf7-f5a7b52cb0d9 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:12.281072 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0014d605-a08e-4889-acf7-f5a7b52cb0d9 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:12.281583 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0014d605-a08e-4889-acf7-f5a7b52cb0d9 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:12.282373 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0014d605-a08e-4889-acf7-f5a7b52cb0d9 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:12.282808 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0014d605-a08e-4889-acf7-f5a7b52cb0d9 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:12.340229 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-463fead1-aa48-4dc8-9925-1332887fdbb1 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:12.340868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-463fead1-aa48-4dc8-9925-1332887fdbb1 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:12.347868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-463fead1-aa48-4dc8-9925-1332887fdbb1 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:12.348311 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-463fead1-aa48-4dc8-9925-1332887fdbb1 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:12.349066 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-463fead1-aa48-4dc8-9925-1332887fdbb1 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:12.349503 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-463fead1-aa48-4dc8-9925-1332887fdbb1 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:12.417255 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0014d605-a08e-4889-acf7-f5a7b52cb0d9 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:12.425378 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-0014d605-a08e-4889-acf7-f5a7b52cb0d9 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1265 microversion: 2.1 time: 0.155732 Jun 15 14:47:12.425976 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 309/597] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:12 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:12.487290 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-463fead1-aa48-4dc8-9925-1332887fdbb1 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:12.494754 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-463fead1-aa48-4dc8-9925-1332887fdbb1 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1258 microversion: 2.1 time: 0.158365 Jun 15 14:47:12.495319 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 289/598] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:12 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:47:12.870063 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-71e2eddb-2a3a-4277-ab76-6896ef2b1c0d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:12.870588 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-71e2eddb-2a3a-4277-ab76-6896ef2b1c0d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:12.876703 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-71e2eddb-2a3a-4277-ab76-6896ef2b1c0d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:12.877149 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-71e2eddb-2a3a-4277-ab76-6896ef2b1c0d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:12.877938 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-71e2eddb-2a3a-4277-ab76-6896ef2b1c0d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:12.878375 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-71e2eddb-2a3a-4277-ab76-6896ef2b1c0d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:13.012948 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-71e2eddb-2a3a-4277-ab76-6896ef2b1c0d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:13.022114 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-71e2eddb-2a3a-4277-ab76-6896ef2b1c0d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:13.023623 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-71e2eddb-2a3a-4277-ab76-6896ef2b1c0d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:13.024765 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-71e2eddb-2a3a-4277-ab76-6896ef2b1c0d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.158762 Jun 15 14:47:13.025318 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 310/599] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:12 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:13.443229 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-e8f38d82-2315-4e8c-bbf6-6d0e76bac129 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:13.443869 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-e8f38d82-2315-4e8c-bbf6-6d0e76bac129 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:13.450535 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e8f38d82-2315-4e8c-bbf6-6d0e76bac129 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:13.450987 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e8f38d82-2315-4e8c-bbf6-6d0e76bac129 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:13.451757 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e8f38d82-2315-4e8c-bbf6-6d0e76bac129 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:13.452199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e8f38d82-2315-4e8c-bbf6-6d0e76bac129 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:13.512191 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-ceda17ea-d320-4387-b189-e39b9daba72c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:13.512818 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-ceda17ea-d320-4387-b189-e39b9daba72c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:13.520426 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ceda17ea-d320-4387-b189-e39b9daba72c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:13.520869 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ceda17ea-d320-4387-b189-e39b9daba72c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:13.521625 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ceda17ea-d320-4387-b189-e39b9daba72c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:13.522122 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ceda17ea-d320-4387-b189-e39b9daba72c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:13.586749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e8f38d82-2315-4e8c-bbf6-6d0e76bac129 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:13.594530 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-e8f38d82-2315-4e8c-bbf6-6d0e76bac129 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1453 microversion: 2.1 time: 0.155113 Jun 15 14:47:13.595098 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 290/600] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:13 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:13.610549 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a8bf9c7f-e547-416b-a911-6581d90a4910 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:13.611160 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a8bf9c7f-e547-416b-a911-6581d90a4910 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:13.617088 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a8bf9c7f-e547-416b-a911-6581d90a4910 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:13.617534 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a8bf9c7f-e547-416b-a911-6581d90a4910 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:13.618336 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a8bf9c7f-e547-416b-a911-6581d90a4910 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:13.618770 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a8bf9c7f-e547-416b-a911-6581d90a4910 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:13.652980 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-ceda17ea-d320-4387-b189-e39b9daba72c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:13.661332 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-ceda17ea-d320-4387-b189-e39b9daba72c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1258 microversion: 2.1 time: 0.152484 Jun 15 14:47:13.661909 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 311/601] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:13 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:47:13.752881 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a8bf9c7f-e547-416b-a911-6581d90a4910 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:13.760321 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a8bf9c7f-e547-416b-a911-6581d90a4910 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1453 microversion: 2.1 time: 0.153466 Jun 15 14:47:13.760884 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 291/602] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:13 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:14.043585 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-7a08a938-5508-4053-b3b6-c33420ff750d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:14.044310 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-7a08a938-5508-4053-b3b6-c33420ff750d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:14.050929 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7a08a938-5508-4053-b3b6-c33420ff750d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:14.051378 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7a08a938-5508-4053-b3b6-c33420ff750d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:14.052145 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7a08a938-5508-4053-b3b6-c33420ff750d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:14.052575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7a08a938-5508-4053-b3b6-c33420ff750d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:14.425791 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-7a08a938-5508-4053-b3b6-c33420ff750d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:14.434235 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-7a08a938-5508-4053-b3b6-c33420ff750d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:14.435738 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-7a08a938-5508-4053-b3b6-c33420ff750d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:14.436898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-7a08a938-5508-4053-b3b6-c33420ff750d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.397285 Jun 15 14:47:14.437460 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 312/603] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:14 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:14.678155 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-28a9e47c-b078-4fcf-83ef-05d2431b7dae tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:14.678783 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-28a9e47c-b078-4fcf-83ef-05d2431b7dae tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:14.686319 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-28a9e47c-b078-4fcf-83ef-05d2431b7dae tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:14.687482 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-28a9e47c-b078-4fcf-83ef-05d2431b7dae tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:14.688668 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-28a9e47c-b078-4fcf-83ef-05d2431b7dae tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:14.689358 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-28a9e47c-b078-4fcf-83ef-05d2431b7dae tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:14.717197 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-f10159a6-39b8-444f-a44d-4c8adda27e4e req-8140962b-6c3e-4af8-9a9c-23775c2de242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123ea48b-cb21-429c-85c6-0ae71d51c1c0", "name": "network-vif-plugged", "status": "completed", "tag": "3b30c106-589d-4777-be4f-8c3b882d514e"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:47:14.729543 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-f10159a6-39b8-444f-a44d-4c8adda27e4e req-8140962b-6c3e-4af8-9a9c-23775c2de242 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:14.730236 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-f10159a6-39b8-444f-a44d-4c8adda27e4e req-8140962b-6c3e-4af8-9a9c-23775c2de242 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:14.743389 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-f10159a6-39b8-444f-a44d-4c8adda27e4e req-8140962b-6c3e-4af8-9a9c-23775c2de242 service nova] Creating event network-vif-plugged:3b30c106-589d-4777-be4f-8c3b882d514e for instance 123ea48b-cb21-429c-85c6-0ae71d51c1c0 on hv-cinder-84327 Jun 15 14:47:14.749055 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-f10159a6-39b8-444f-a44d-4c8adda27e4e req-8140962b-6c3e-4af8-9a9c-23775c2de242 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038063 Jun 15 14:47:14.753210 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 313/604] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:47:14.910618 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-28a9e47c-b078-4fcf-83ef-05d2431b7dae tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:14.918646 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-28a9e47c-b078-4fcf-83ef-05d2431b7dae tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1258 microversion: 2.1 time: 0.243712 Jun 15 14:47:14.919228 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 292/605] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:14 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1258 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:15.459291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-81a60f99-15ca-4210-a59f-e20ee7191ad6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:15.460070 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-81a60f99-15ca-4210-a59f-e20ee7191ad6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:15.466634 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-81a60f99-15ca-4210-a59f-e20ee7191ad6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:15.467420 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-81a60f99-15ca-4210-a59f-e20ee7191ad6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:15.468270 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-81a60f99-15ca-4210-a59f-e20ee7191ad6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:15.468783 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-81a60f99-15ca-4210-a59f-e20ee7191ad6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:15.493478 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-54e7aa5c-e2b8-48a3-9511-1243f95ca0d9 req-8bc80ef5-cb0e-4e70-868a-c8ba0eebbb70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9104e014-d497-460a-8215-6439f0a2e521", "tag": "bc9c90a6-a5e4-499e-bc4a-d030962cd9bc"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:47:15.502122 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-54e7aa5c-e2b8-48a3-9511-1243f95ca0d9 req-8bc80ef5-cb0e-4e70-868a-c8ba0eebbb70 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:15.502568 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-54e7aa5c-e2b8-48a3-9511-1243f95ca0d9 req-8bc80ef5-cb0e-4e70-868a-c8ba0eebbb70 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:15.514198 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-54e7aa5c-e2b8-48a3-9511-1243f95ca0d9 req-8bc80ef5-cb0e-4e70-868a-c8ba0eebbb70 service nova] Creating event network-changed:bc9c90a6-a5e4-499e-bc4a-d030962cd9bc for instance 9104e014-d497-460a-8215-6439f0a2e521 on hv-cinder-84327 Jun 15 14:47:15.520390 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-54e7aa5c-e2b8-48a3-9511-1243f95ca0d9 req-8bc80ef5-cb0e-4e70-868a-c8ba0eebbb70 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030510 Jun 15 14:47:15.521000 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 293/606] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:47:15.609826 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-81a60f99-15ca-4210-a59f-e20ee7191ad6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:15.612337 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=100 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:47:15.620879 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-81a60f99-15ca-4210-a59f-e20ee7191ad6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:15.622545 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-81a60f99-15ca-4210-a59f-e20ee7191ad6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:15.623873 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-81a60f99-15ca-4210-a59f-e20ee7191ad6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.171857 Jun 15 14:47:15.624438 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 314/607] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:15 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:15.936181 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c6c1a073-609e-4752-a8b1-29b706ba1fa0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:15.936906 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-c6c1a073-609e-4752-a8b1-29b706ba1fa0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:15.961014 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c6c1a073-609e-4752-a8b1-29b706ba1fa0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:15.961646 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c6c1a073-609e-4752-a8b1-29b706ba1fa0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:15.962820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c6c1a073-609e-4752-a8b1-29b706ba1fa0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:15.963190 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c6c1a073-609e-4752-a8b1-29b706ba1fa0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:16.118593 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-c6c1a073-609e-4752-a8b1-29b706ba1fa0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:16.126982 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-c6c1a073-609e-4752-a8b1-29b706ba1fa0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1258 microversion: 2.1 time: 0.195224 Jun 15 14:47:16.127779 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 294/608] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:15 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1258 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:16.642220 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-6cd40982-4cd7-40d2-99da-f59bb1a106d8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:16.642941 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-6cd40982-4cd7-40d2-99da-f59bb1a106d8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:16.649592 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6cd40982-4cd7-40d2-99da-f59bb1a106d8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:16.650075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6cd40982-4cd7-40d2-99da-f59bb1a106d8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:16.650854 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6cd40982-4cd7-40d2-99da-f59bb1a106d8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:16.651293 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6cd40982-4cd7-40d2-99da-f59bb1a106d8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:16.781765 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-6cd40982-4cd7-40d2-99da-f59bb1a106d8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:16.790257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-6cd40982-4cd7-40d2-99da-f59bb1a106d8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:16.791756 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-6cd40982-4cd7-40d2-99da-f59bb1a106d8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:16.792940 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-6cd40982-4cd7-40d2-99da-f59bb1a106d8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.155464 Jun 15 14:47:16.793483 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 315/609] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:16 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:17.144089 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-5bf71298-b834-44e4-98b1-7d9826b07885 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:17.144604 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-5bf71298-b834-44e4-98b1-7d9826b07885 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:17.151176 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5bf71298-b834-44e4-98b1-7d9826b07885 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:17.151623 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5bf71298-b834-44e4-98b1-7d9826b07885 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:17.152383 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5bf71298-b834-44e4-98b1-7d9826b07885 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:17.152819 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5bf71298-b834-44e4-98b1-7d9826b07885 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:17.282563 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-5bf71298-b834-44e4-98b1-7d9826b07885 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:17.289942 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-5bf71298-b834-44e4-98b1-7d9826b07885 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1258 microversion: 2.1 time: 0.149723 Jun 15 14:47:17.290511 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 295/610] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:17 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:17.812152 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c9471f88-38a2-42d0-956f-ce466c8dfd7b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:17.812854 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c9471f88-38a2-42d0-956f-ce466c8dfd7b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:17.819430 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c9471f88-38a2-42d0-956f-ce466c8dfd7b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:17.819881 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c9471f88-38a2-42d0-956f-ce466c8dfd7b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:17.820645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c9471f88-38a2-42d0-956f-ce466c8dfd7b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:17.821086 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c9471f88-38a2-42d0-956f-ce466c8dfd7b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:18.011592 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c9471f88-38a2-42d0-956f-ce466c8dfd7b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:18.020596 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c9471f88-38a2-42d0-956f-ce466c8dfd7b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:18.022119 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c9471f88-38a2-42d0-956f-ce466c8dfd7b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:18.023275 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-c9471f88-38a2-42d0-956f-ce466c8dfd7b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.215011 Jun 15 14:47:18.023834 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 316/611] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:17 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:18.307498 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6c68ab5f-1c69-4ec9-a3da-7aeeb4c2b6ac tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:18.308235 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6c68ab5f-1c69-4ec9-a3da-7aeeb4c2b6ac tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:18.316123 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6c68ab5f-1c69-4ec9-a3da-7aeeb4c2b6ac tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:18.316575 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6c68ab5f-1c69-4ec9-a3da-7aeeb4c2b6ac tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:18.317335 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6c68ab5f-1c69-4ec9-a3da-7aeeb4c2b6ac tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:18.317806 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6c68ab5f-1c69-4ec9-a3da-7aeeb4c2b6ac tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:18.452370 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6c68ab5f-1c69-4ec9-a3da-7aeeb4c2b6ac tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:18.460693 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-6c68ab5f-1c69-4ec9-a3da-7aeeb4c2b6ac tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1258 microversion: 2.1 time: 0.157277 Jun 15 14:47:18.461251 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 296/612] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:18 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:19.042390 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-92c8b0ba-43de-426f-88d8-9647df0cd87e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:19.042998 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-92c8b0ba-43de-426f-88d8-9647df0cd87e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:19.050283 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-92c8b0ba-43de-426f-88d8-9647df0cd87e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:19.050734 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-92c8b0ba-43de-426f-88d8-9647df0cd87e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:19.051495 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-92c8b0ba-43de-426f-88d8-9647df0cd87e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:19.051931 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-92c8b0ba-43de-426f-88d8-9647df0cd87e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:19.180875 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-92c8b0ba-43de-426f-88d8-9647df0cd87e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:19.189379 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-92c8b0ba-43de-426f-88d8-9647df0cd87e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:19.190913 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-92c8b0ba-43de-426f-88d8-9647df0cd87e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:19.192091 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-92c8b0ba-43de-426f-88d8-9647df0cd87e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.153610 Jun 15 14:47:19.192642 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 317/613] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:19 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:19.478326 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6144c82c-4065-47d7-8dc6-94dcf677324f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:19.478944 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6144c82c-4065-47d7-8dc6-94dcf677324f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:19.481385 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=97 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:47:19.487297 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6144c82c-4065-47d7-8dc6-94dcf677324f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:19.487756 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6144c82c-4065-47d7-8dc6-94dcf677324f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:19.488539 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6144c82c-4065-47d7-8dc6-94dcf677324f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:19.488977 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6144c82c-4065-47d7-8dc6-94dcf677324f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:19.624962 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6144c82c-4065-47d7-8dc6-94dcf677324f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:19.634444 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-6144c82c-4065-47d7-8dc6-94dcf677324f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1258 microversion: 2.1 time: 0.159879 Jun 15 14:47:19.635265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 297/614] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:19 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:19.654944 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-f79a2ffc-2733-4be6-adf5-e112bbbe3f94 req-47a30567-224a-4303-be3b-bdbc70f52a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fdd6732-ba3a-4243-a57f-7e84f8eea531", "name": "network-vif-plugged", "status": "completed", "tag": "457c9267-d5cd-492d-9292-3d4518f9d2bb"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:47:19.665878 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-f79a2ffc-2733-4be6-adf5-e112bbbe3f94 req-47a30567-224a-4303-be3b-bdbc70f52a26 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:19.666333 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-f79a2ffc-2733-4be6-adf5-e112bbbe3f94 req-47a30567-224a-4303-be3b-bdbc70f52a26 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:19.679730 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-f79a2ffc-2733-4be6-adf5-e112bbbe3f94 req-47a30567-224a-4303-be3b-bdbc70f52a26 service nova] Creating event network-vif-plugged:457c9267-d5cd-492d-9292-3d4518f9d2bb for instance 3fdd6732-ba3a-4243-a57f-7e84f8eea531 on hv-cinder-84327 Jun 15 14:47:19.687206 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-f79a2ffc-2733-4be6-adf5-e112bbbe3f94 req-47a30567-224a-4303-be3b-bdbc70f52a26 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041501 Jun 15 14:47:19.687863 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 318/615] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:47:20.210598 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-de569b7b-f486-4ed8-98d1-6c75b4ad242c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:20.211205 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-de569b7b-f486-4ed8-98d1-6c75b4ad242c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:20.217574 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-de569b7b-f486-4ed8-98d1-6c75b4ad242c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:20.218018 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-de569b7b-f486-4ed8-98d1-6c75b4ad242c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:20.218776 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-de569b7b-f486-4ed8-98d1-6c75b4ad242c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:20.219269 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-de569b7b-f486-4ed8-98d1-6c75b4ad242c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:20.352114 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-de569b7b-f486-4ed8-98d1-6c75b4ad242c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:20.361281 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-de569b7b-f486-4ed8-98d1-6c75b4ad242c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:20.362818 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-de569b7b-f486-4ed8-98d1-6c75b4ad242c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:20.363978 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-de569b7b-f486-4ed8-98d1-6c75b4ad242c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1808 microversion: 2.20 time: 0.157269 Jun 15 14:47:20.364541 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 298/616] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:20 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:20.652811 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-dfb44df1-a3fc-430f-85be-00e5643d3bf4 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:20.653515 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-dfb44df1-a3fc-430f-85be-00e5643d3bf4 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:20.660267 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-dfb44df1-a3fc-430f-85be-00e5643d3bf4 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:20.660723 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-dfb44df1-a3fc-430f-85be-00e5643d3bf4 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:20.661486 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-dfb44df1-a3fc-430f-85be-00e5643d3bf4 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:20.662003 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-dfb44df1-a3fc-430f-85be-00e5643d3bf4 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:20.796289 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-dfb44df1-a3fc-430f-85be-00e5643d3bf4 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:20.803941 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-dfb44df1-a3fc-430f-85be-00e5643d3bf4 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1258 microversion: 2.1 time: 0.155815 Jun 15 14:47:20.804500 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 319/617] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:20 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:21.382627 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-7ea03917-4f6d-46f3-b1c4-741068a2f55d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:21.383263 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-7ea03917-4f6d-46f3-b1c4-741068a2f55d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:21.389880 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7ea03917-4f6d-46f3-b1c4-741068a2f55d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:21.390327 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7ea03917-4f6d-46f3-b1c4-741068a2f55d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:21.391297 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7ea03917-4f6d-46f3-b1c4-741068a2f55d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:21.391865 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7ea03917-4f6d-46f3-b1c4-741068a2f55d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:21.519750 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-7ea03917-4f6d-46f3-b1c4-741068a2f55d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:21.528113 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-7ea03917-4f6d-46f3-b1c4-741068a2f55d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:21.529595 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-7ea03917-4f6d-46f3-b1c4-741068a2f55d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:21.530772 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-7ea03917-4f6d-46f3-b1c4-741068a2f55d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1795 microversion: 2.20 time: 0.152219 Jun 15 14:47:21.531316 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 299/618] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:47:21 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1795 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:47:21.820420 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0922e59d-fe7f-485b-a74f-4fcb50776511 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:21.821193 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-0922e59d-fe7f-485b-a74f-4fcb50776511 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:21.827871 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0922e59d-fe7f-485b-a74f-4fcb50776511 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:21.828316 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0922e59d-fe7f-485b-a74f-4fcb50776511 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:21.829761 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0922e59d-fe7f-485b-a74f-4fcb50776511 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:21.830198 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0922e59d-fe7f-485b-a74f-4fcb50776511 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:21.964449 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0922e59d-fe7f-485b-a74f-4fcb50776511 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:21.972339 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-0922e59d-fe7f-485b-a74f-4fcb50776511 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1258 microversion: 2.1 time: 0.155710 Jun 15 14:47:21.972901 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 320/619] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:21 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:22.989530 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-4ec0ed8a-773c-47a6-a9e8-df67c5234263 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:22.990199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-4ec0ed8a-773c-47a6-a9e8-df67c5234263 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:22.996706 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4ec0ed8a-773c-47a6-a9e8-df67c5234263 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:22.997158 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4ec0ed8a-773c-47a6-a9e8-df67c5234263 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:22.998002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4ec0ed8a-773c-47a6-a9e8-df67c5234263 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:22.998446 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4ec0ed8a-773c-47a6-a9e8-df67c5234263 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:23.127825 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-4ec0ed8a-773c-47a6-a9e8-df67c5234263 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:23.135304 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-4ec0ed8a-773c-47a6-a9e8-df67c5234263 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1441 microversion: 2.1 time: 0.149780 Jun 15 14:47:23.135860 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 300/620] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:22 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1441 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:23.151391 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-47dfdb97-8c93-48f2-9c47-423332965028 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:23.152007 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-47dfdb97-8c93-48f2-9c47-423332965028 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:23.154551 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:47:23.160624 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-47dfdb97-8c93-48f2-9c47-423332965028 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:23.161074 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-47dfdb97-8c93-48f2-9c47-423332965028 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:23.161905 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-47dfdb97-8c93-48f2-9c47-423332965028 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:23.162348 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-47dfdb97-8c93-48f2-9c47-423332965028 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:23.297023 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-47dfdb97-8c93-48f2-9c47-423332965028 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:23.305073 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-47dfdb97-8c93-48f2-9c47-423332965028 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1441 microversion: 2.1 time: 0.157509 Jun 15 14:47:23.305621 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 321/621] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:23 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1441 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:25.130208 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-8af7289c-888b-4d38-8106-c7fccb132729 req-627f0014-7003-4b9f-8f31-1702e13d931c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fdd6732-ba3a-4243-a57f-7e84f8eea531", "tag": "457c9267-d5cd-492d-9292-3d4518f9d2bb"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:47:25.138743 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-8af7289c-888b-4d38-8106-c7fccb132729 req-627f0014-7003-4b9f-8f31-1702e13d931c service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:25.139195 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-8af7289c-888b-4d38-8106-c7fccb132729 req-627f0014-7003-4b9f-8f31-1702e13d931c service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:25.150111 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-8af7289c-888b-4d38-8106-c7fccb132729 req-627f0014-7003-4b9f-8f31-1702e13d931c service nova] Creating event network-changed:457c9267-d5cd-492d-9292-3d4518f9d2bb for instance 3fdd6732-ba3a-4243-a57f-7e84f8eea531 on hv-cinder-84327 Jun 15 14:47:25.155108 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-8af7289c-888b-4d38-8106-c7fccb132729 req-627f0014-7003-4b9f-8f31-1702e13d931c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029303 Jun 15 14:47:25.155708 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 301/622] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:47:41.616383 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0f177406-b6d5-4396-b0dc-70d0e916da85 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:41.617056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-0f177406-b6d5-4396-b0dc-70d0e916da85 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:41.619064 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=1 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:47:41.619717 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=39 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:47:41.625720 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0f177406-b6d5-4396-b0dc-70d0e916da85 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:41.626172 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0f177406-b6d5-4396-b0dc-70d0e916da85 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:41.627007 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0f177406-b6d5-4396-b0dc-70d0e916da85 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:41.627459 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0f177406-b6d5-4396-b0dc-70d0e916da85 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:41.750932 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.objects.instance [None req-0f177406-b6d5-4396-b0dc-70d0e916da85 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lazy-loading 'services' on Instance uuid 401c9feb-30ca-4df6-9fba-0a05da5dce7b {{(pid=124219) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:47:41.868059 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-0f177406-b6d5-4396-b0dc-70d0e916da85 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "DELETE /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b/os-volume_attachments/3e6efbb0-c846-4ae5-89ff-ab34944f79b3" status: 202 len: 0 microversion: 2.1 time: 0.255850 Jun 15 14:47:41.868667 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 322/623] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Jun 15 14:47:41 2022] DELETE /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b/os-volume_attachments/3e6efbb0-c846-4ae5-89ff-ab34944f79b3 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:47:44.029446 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=9 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:47:44.030221 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=90 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:47:44.034949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c3be4b4c-ca27-4203-820b-821dbe619575 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:47:44.042009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c3be4b4c-ca27-4203-820b-821dbe619575 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:44.042464 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c3be4b4c-ca27-4203-820b-821dbe619575 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:44.101535 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-c3be4b4c-ca27-4203-820b-821dbe619575 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Going to try to stop instance {{(pid=124220) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 15 14:47:44.144858 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-c3be4b4c-ca27-4203-820b-821dbe619575 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "POST /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b/action" status: 202 len: 0 microversion: 2.1 time: 0.116841 Jun 15 14:47:44.145510 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 302/624] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 14:47:44 2022] POST /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:47:44.154885 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-bff41714-e0af-4b19-9df6-21a0a0ea230d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:44.155595 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-bff41714-e0af-4b19-9df6-21a0a0ea230d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:44.162599 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bff41714-e0af-4b19-9df6-21a0a0ea230d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:44.163055 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bff41714-e0af-4b19-9df6-21a0a0ea230d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:44.163838 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bff41714-e0af-4b19-9df6-21a0a0ea230d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:44.164276 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bff41714-e0af-4b19-9df6-21a0a0ea230d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:44.294180 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-bff41714-e0af-4b19-9df6-21a0a0ea230d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:44.302336 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-bff41714-e0af-4b19-9df6-21a0a0ea230d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1679 microversion: 2.1 time: 0.152455 Jun 15 14:47:44.302910 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 323/625] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:44 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:47:45.321843 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-5202f20d-4ff7-499e-bdc2-6de7bc5e342d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:45.322539 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-5202f20d-4ff7-499e-bdc2-6de7bc5e342d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:45.328852 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5202f20d-4ff7-499e-bdc2-6de7bc5e342d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:45.329299 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5202f20d-4ff7-499e-bdc2-6de7bc5e342d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:45.330092 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5202f20d-4ff7-499e-bdc2-6de7bc5e342d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:45.331054 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5202f20d-4ff7-499e-bdc2-6de7bc5e342d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:45.462425 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-5202f20d-4ff7-499e-bdc2-6de7bc5e342d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:45.470071 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-5202f20d-4ff7-499e-bdc2-6de7bc5e342d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1679 microversion: 2.1 time: 0.152905 Jun 15 14:47:45.470628 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 303/626] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:45 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:46.487998 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-afa2ed88-21be-437e-a073-6b7ca77f867a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:46.488611 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-afa2ed88-21be-437e-a073-6b7ca77f867a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:46.495256 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-afa2ed88-21be-437e-a073-6b7ca77f867a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:46.496026 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-afa2ed88-21be-437e-a073-6b7ca77f867a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:46.497353 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-afa2ed88-21be-437e-a073-6b7ca77f867a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:46.498163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-afa2ed88-21be-437e-a073-6b7ca77f867a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:46.631127 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-afa2ed88-21be-437e-a073-6b7ca77f867a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:46.638615 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-afa2ed88-21be-437e-a073-6b7ca77f867a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1679 microversion: 2.1 time: 0.154570 Jun 15 14:47:46.639227 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 324/627] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:46 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:47.656211 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-ebf2d5b0-97b6-4257-b84f-171ff46936ba tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:47.656822 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-ebf2d5b0-97b6-4257-b84f-171ff46936ba tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:47.664467 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ebf2d5b0-97b6-4257-b84f-171ff46936ba tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:47.664915 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ebf2d5b0-97b6-4257-b84f-171ff46936ba tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:47.665758 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ebf2d5b0-97b6-4257-b84f-171ff46936ba tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:47.666207 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ebf2d5b0-97b6-4257-b84f-171ff46936ba tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:47.797606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ebf2d5b0-97b6-4257-b84f-171ff46936ba tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:47.805410 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-ebf2d5b0-97b6-4257-b84f-171ff46936ba tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1679 microversion: 2.1 time: 0.153069 Jun 15 14:47:47.806011 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 304/628] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:47 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:48.822576 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3dd15f7a-45f5-416d-a987-38ac9b329714 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:48.823182 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-3dd15f7a-45f5-416d-a987-38ac9b329714 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:48.829573 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3dd15f7a-45f5-416d-a987-38ac9b329714 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:48.830047 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3dd15f7a-45f5-416d-a987-38ac9b329714 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:48.830792 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3dd15f7a-45f5-416d-a987-38ac9b329714 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:48.831223 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3dd15f7a-45f5-416d-a987-38ac9b329714 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:48.963486 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-3dd15f7a-45f5-416d-a987-38ac9b329714 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:48.971144 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-3dd15f7a-45f5-416d-a987-38ac9b329714 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1679 microversion: 2.1 time: 0.152445 Jun 15 14:47:48.971706 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 325/629] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:48 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:47:49.988814 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-60834359-abe9-41d3-96d9-43eab44f9555 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:49.989417 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-60834359-abe9-41d3-96d9-43eab44f9555 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:49.996525 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-60834359-abe9-41d3-96d9-43eab44f9555 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:49.996983 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-60834359-abe9-41d3-96d9-43eab44f9555 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:49.997793 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-60834359-abe9-41d3-96d9-43eab44f9555 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:49.998227 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-60834359-abe9-41d3-96d9-43eab44f9555 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:50.126032 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-60834359-abe9-41d3-96d9-43eab44f9555 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:50.133820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-60834359-abe9-41d3-96d9-43eab44f9555 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1679 microversion: 2.1 time: 0.149374 Jun 15 14:47:50.134389 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 305/630] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:49 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:51.151377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-b870107a-0c16-4a36-992c-5dd566d9b539 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:51.151989 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-b870107a-0c16-4a36-992c-5dd566d9b539 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:51.158512 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b870107a-0c16-4a36-992c-5dd566d9b539 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:51.158963 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b870107a-0c16-4a36-992c-5dd566d9b539 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:51.159725 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b870107a-0c16-4a36-992c-5dd566d9b539 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:51.160162 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b870107a-0c16-4a36-992c-5dd566d9b539 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:51.287445 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b870107a-0c16-4a36-992c-5dd566d9b539 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:51.294859 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-b870107a-0c16-4a36-992c-5dd566d9b539 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1679 microversion: 2.1 time: 0.147518 Jun 15 14:47:51.295415 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 326/631] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:51 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:52.312193 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-8832cde2-1a9f-4a53-8940-bac1c936b62c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:52.312799 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-8832cde2-1a9f-4a53-8940-bac1c936b62c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:52.320433 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8832cde2-1a9f-4a53-8940-bac1c936b62c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:52.321002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8832cde2-1a9f-4a53-8940-bac1c936b62c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:52.321880 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8832cde2-1a9f-4a53-8940-bac1c936b62c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:52.322563 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8832cde2-1a9f-4a53-8940-bac1c936b62c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:52.451379 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-8832cde2-1a9f-4a53-8940-bac1c936b62c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:52.459817 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-8832cde2-1a9f-4a53-8940-bac1c936b62c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1679 microversion: 2.1 time: 0.151508 Jun 15 14:47:52.460390 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 306/632] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:52 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:53.476301 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f7ef581d-8be8-494c-b1c8-ef62a49f3266 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:53.476904 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f7ef581d-8be8-494c-b1c8-ef62a49f3266 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:53.483872 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f7ef581d-8be8-494c-b1c8-ef62a49f3266 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:53.484323 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f7ef581d-8be8-494c-b1c8-ef62a49f3266 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:53.485090 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f7ef581d-8be8-494c-b1c8-ef62a49f3266 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:53.485530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f7ef581d-8be8-494c-b1c8-ef62a49f3266 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:53.618208 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f7ef581d-8be8-494c-b1c8-ef62a49f3266 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:53.625595 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f7ef581d-8be8-494c-b1c8-ef62a49f3266 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1679 microversion: 2.1 time: 0.153203 Jun 15 14:47:53.626295 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 327/633] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:53 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:54.642617 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-aa1766d5-87b0-4704-8b69-ad05c570c3e3 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:54.643261 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-aa1766d5-87b0-4704-8b69-ad05c570c3e3 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:54.649768 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-aa1766d5-87b0-4704-8b69-ad05c570c3e3 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:54.650222 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-aa1766d5-87b0-4704-8b69-ad05c570c3e3 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:54.650989 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-aa1766d5-87b0-4704-8b69-ad05c570c3e3 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:54.651426 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-aa1766d5-87b0-4704-8b69-ad05c570c3e3 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:54.783989 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-aa1766d5-87b0-4704-8b69-ad05c570c3e3 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:54.791616 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-aa1766d5-87b0-4704-8b69-ad05c570c3e3 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1679 microversion: 2.1 time: 0.152850 Jun 15 14:47:54.792187 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 307/634] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:54 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:55.808520 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-83d5add9-6307-4bf5-ad4b-ef86daba5705 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:55.809134 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-83d5add9-6307-4bf5-ad4b-ef86daba5705 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:55.815571 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-83d5add9-6307-4bf5-ad4b-ef86daba5705 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:55.816023 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-83d5add9-6307-4bf5-ad4b-ef86daba5705 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:55.816781 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-83d5add9-6307-4bf5-ad4b-ef86daba5705 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:55.817248 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-83d5add9-6307-4bf5-ad4b-ef86daba5705 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:55.951099 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-83d5add9-6307-4bf5-ad4b-ef86daba5705 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:55.959936 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-83d5add9-6307-4bf5-ad4b-ef86daba5705 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1679 microversion: 2.1 time: 0.155226 Jun 15 14:47:55.960514 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 328/635] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:55 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:56.977152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-8e91635c-b084-44fb-b7b3-97def1a5807a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:56.978004 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-8e91635c-b084-44fb-b7b3-97def1a5807a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:56.984170 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8e91635c-b084-44fb-b7b3-97def1a5807a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:56.984641 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8e91635c-b084-44fb-b7b3-97def1a5807a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:56.985392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8e91635c-b084-44fb-b7b3-97def1a5807a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:56.985856 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8e91635c-b084-44fb-b7b3-97def1a5807a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:57.114271 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-8e91635c-b084-44fb-b7b3-97def1a5807a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:57.122914 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-8e91635c-b084-44fb-b7b3-97def1a5807a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1679 microversion: 2.1 time: 0.150502 Jun 15 14:47:57.123467 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 308/636] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:56 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:58.140362 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-08725835-1d5e-4f4e-b33a-1ffad33440d4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:58.140979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-08725835-1d5e-4f4e-b33a-1ffad33440d4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:58.148117 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-08725835-1d5e-4f4e-b33a-1ffad33440d4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:58.148573 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-08725835-1d5e-4f4e-b33a-1ffad33440d4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:58.149331 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-08725835-1d5e-4f4e-b33a-1ffad33440d4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:58.149800 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-08725835-1d5e-4f4e-b33a-1ffad33440d4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:58.280903 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-08725835-1d5e-4f4e-b33a-1ffad33440d4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:58.289405 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-08725835-1d5e-4f4e-b33a-1ffad33440d4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1679 microversion: 2.1 time: 0.152950 Jun 15 14:47:58.290025 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 329/637] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:58 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:47:59.307274 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-513d55a5-5a5c-4acc-8463-2099022c983e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:47:59.307892 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-513d55a5-5a5c-4acc-8463-2099022c983e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:47:59.315702 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-513d55a5-5a5c-4acc-8463-2099022c983e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:59.316154 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-513d55a5-5a5c-4acc-8463-2099022c983e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:59.316921 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-513d55a5-5a5c-4acc-8463-2099022c983e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:47:59.317360 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-513d55a5-5a5c-4acc-8463-2099022c983e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:47:59.449740 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-513d55a5-5a5c-4acc-8463-2099022c983e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:47:59.457278 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-513d55a5-5a5c-4acc-8463-2099022c983e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1679 microversion: 2.1 time: 0.153897 Jun 15 14:47:59.457806 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 309/638] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:47:59 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:00.475772 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-84b727a4-e345-4423-ba81-f7e59932ac3a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:00.476392 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-84b727a4-e345-4423-ba81-f7e59932ac3a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:00.482874 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-84b727a4-e345-4423-ba81-f7e59932ac3a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:00.483325 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-84b727a4-e345-4423-ba81-f7e59932ac3a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:00.484089 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-84b727a4-e345-4423-ba81-f7e59932ac3a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:00.484526 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-84b727a4-e345-4423-ba81-f7e59932ac3a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:00.614301 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-84b727a4-e345-4423-ba81-f7e59932ac3a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:00.621679 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-84b727a4-e345-4423-ba81-f7e59932ac3a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1679 microversion: 2.1 time: 0.150432 Jun 15 14:48:00.622254 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 330/639] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:00 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:01.638368 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-17c6390c-b35c-4639-945c-83ca46678d75 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:01.639014 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-17c6390c-b35c-4639-945c-83ca46678d75 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:01.645437 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-17c6390c-b35c-4639-945c-83ca46678d75 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:01.645955 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-17c6390c-b35c-4639-945c-83ca46678d75 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:01.646819 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-17c6390c-b35c-4639-945c-83ca46678d75 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:01.647251 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-17c6390c-b35c-4639-945c-83ca46678d75 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:01.775989 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-17c6390c-b35c-4639-945c-83ca46678d75 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:01.783435 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-17c6390c-b35c-4639-945c-83ca46678d75 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1679 microversion: 2.1 time: 0.148956 Jun 15 14:48:01.784003 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 310/640] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:01 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:02.800250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-802e3360-5c8b-40a8-8242-69eedb806711 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:02.800836 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-802e3360-5c8b-40a8-8242-69eedb806711 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:02.807585 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-802e3360-5c8b-40a8-8242-69eedb806711 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:02.808037 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-802e3360-5c8b-40a8-8242-69eedb806711 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:02.808801 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-802e3360-5c8b-40a8-8242-69eedb806711 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:02.809235 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-802e3360-5c8b-40a8-8242-69eedb806711 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:02.997140 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-802e3360-5c8b-40a8-8242-69eedb806711 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:03.004686 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-802e3360-5c8b-40a8-8242-69eedb806711 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1679 microversion: 2.1 time: 0.208300 Jun 15 14:48:03.005301 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 331/641] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:02 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1679 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:04.022065 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-59a2e78e-a927-4549-af6d-1a6d4dfaee51 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:04.022833 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-59a2e78e-a927-4549-af6d-1a6d4dfaee51 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:04.029267 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-59a2e78e-a927-4549-af6d-1a6d4dfaee51 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:04.029735 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-59a2e78e-a927-4549-af6d-1a6d4dfaee51 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:04.030491 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-59a2e78e-a927-4549-af6d-1a6d4dfaee51 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:04.030922 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-59a2e78e-a927-4549-af6d-1a6d4dfaee51 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:04.208669 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-59a2e78e-a927-4549-af6d-1a6d4dfaee51 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:04.216495 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-59a2e78e-a927-4549-af6d-1a6d4dfaee51 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1679 microversion: 2.1 time: 0.198481 Jun 15 14:48:04.217059 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 311/642] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:04 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1679 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:05.233779 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-a5c3eafe-17ec-4541-ae73-a559d4fb280b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:05.234399 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-a5c3eafe-17ec-4541-ae73-a559d4fb280b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:05.240940 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a5c3eafe-17ec-4541-ae73-a559d4fb280b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:05.241388 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a5c3eafe-17ec-4541-ae73-a559d4fb280b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:05.242176 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a5c3eafe-17ec-4541-ae73-a559d4fb280b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:05.242615 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a5c3eafe-17ec-4541-ae73-a559d4fb280b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:05.373982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-a5c3eafe-17ec-4541-ae73-a559d4fb280b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:05.381999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-a5c3eafe-17ec-4541-ae73-a559d4fb280b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1656 microversion: 2.1 time: 0.151519 Jun 15 14:48:05.382577 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 332/643] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:05 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1656 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:48:05.398762 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-531a7076-f943-4658-be05-8e92c93151a4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:05.405321 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-531a7076-f943-4658-be05-8e92c93151a4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:05.405803 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-531a7076-f943-4658-be05-8e92c93151a4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:05.427086 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-531a7076-f943-4658-be05-8e92c93151a4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Going to try to start instance {{(pid=124220) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 15 14:48:05.469991 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-531a7076-f943-4658-be05-8e92c93151a4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "POST /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b/action" status: 202 len: 0 microversion: 2.1 time: 0.075627 Jun 15 14:48:05.470646 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 312/644] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 14:48:05 2022] POST /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 14:48:05.478821 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f2f3a709-4f92-4019-9ece-c6fefc773f9c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:05.479441 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f2f3a709-4f92-4019-9ece-c6fefc773f9c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:05.485506 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f2f3a709-4f92-4019-9ece-c6fefc773f9c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:05.486003 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f2f3a709-4f92-4019-9ece-c6fefc773f9c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:05.486767 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f2f3a709-4f92-4019-9ece-c6fefc773f9c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:05.487251 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f2f3a709-4f92-4019-9ece-c6fefc773f9c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:05.629307 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f2f3a709-4f92-4019-9ece-c6fefc773f9c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:05.637500 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f2f3a709-4f92-4019-9ece-c6fefc773f9c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1665 microversion: 2.1 time: 0.162604 Jun 15 14:48:05.638127 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 333/645] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:05 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1665 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:06.655985 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c4e1621d-b1e2-4a0f-8188-76e4759fc48c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:06.656680 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-c4e1621d-b1e2-4a0f-8188-76e4759fc48c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:06.664006 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c4e1621d-b1e2-4a0f-8188-76e4759fc48c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:06.664453 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c4e1621d-b1e2-4a0f-8188-76e4759fc48c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:06.665221 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c4e1621d-b1e2-4a0f-8188-76e4759fc48c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:06.665679 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c4e1621d-b1e2-4a0f-8188-76e4759fc48c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:06.800615 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-c4e1621d-b1e2-4a0f-8188-76e4759fc48c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:06.808936 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-c4e1621d-b1e2-4a0f-8188-76e4759fc48c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1665 microversion: 2.1 time: 0.157176 Jun 15 14:48:06.809505 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 313/646] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:06 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1665 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:07.825267 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0b8c0488-e3a4-4d72-af4d-f296715d68e1 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:07.825904 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-0b8c0488-e3a4-4d72-af4d-f296715d68e1 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:07.832420 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0b8c0488-e3a4-4d72-af4d-f296715d68e1 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:07.832871 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0b8c0488-e3a4-4d72-af4d-f296715d68e1 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:07.833630 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0b8c0488-e3a4-4d72-af4d-f296715d68e1 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:07.834095 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0b8c0488-e3a4-4d72-af4d-f296715d68e1 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:07.967264 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0b8c0488-e3a4-4d72-af4d-f296715d68e1 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:07.975828 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-0b8c0488-e3a4-4d72-af4d-f296715d68e1 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1665 microversion: 2.1 time: 0.153595 Jun 15 14:48:07.976424 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 334/647] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:07 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:08.993462 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1d8f8772-4216-44a2-af10-e4603debc7ab tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:08.994122 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1d8f8772-4216-44a2-af10-e4603debc7ab tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:09.000623 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1d8f8772-4216-44a2-af10-e4603debc7ab tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:09.001075 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1d8f8772-4216-44a2-af10-e4603debc7ab tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:09.001879 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1d8f8772-4216-44a2-af10-e4603debc7ab tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:09.002323 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1d8f8772-4216-44a2-af10-e4603debc7ab tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:09.130999 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-1d8f8772-4216-44a2-af10-e4603debc7ab tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:09.138846 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-1d8f8772-4216-44a2-af10-e4603debc7ab tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1669 microversion: 2.1 time: 0.150076 Jun 15 14:48:09.139415 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 314/648] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:08 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1669 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:09.518511 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-5c3be190-8f90-40ba-b4eb-b77df26a84f8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1546716075"}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:09.519040 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-5c3be190-8f90-40ba-b4eb-b77df26a84f8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:09.526504 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5c3be190-8f90-40ba-b4eb-b77df26a84f8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:09.526888 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5c3be190-8f90-40ba-b4eb-b77df26a84f8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:09.527636 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5c3be190-8f90-40ba-b4eb-b77df26a84f8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:09.528063 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5c3be190-8f90-40ba-b4eb-b77df26a84f8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:09.657424 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.network.security_group_api [None req-5c3be190-8f90-40ba-b4eb-b77df26a84f8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Removing security group eebe3e00-eb11-4fab-a1df-5aeadc19f6e9 from port 72e53405-4f12-4857-b499-0ea88b11d04e Jun 15 14:48:09.999810 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-5c3be190-8f90-40ba-b4eb-b77df26a84f8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "POST /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e/action" status: 202 len: 0 microversion: 2.1 time: 0.484414 Jun 15 14:48:10.004476 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 335/649] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 14:48:09 2022] POST /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:48:10.018108 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-ea94d116-f008-4b31-840f-2649a5b9afae req-012901f5-8735-4c6e-8465-3cdaf9606205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "080870aa-ea48-4010-a1cf-1fbf6c52b03e", "tag": "72e53405-4f12-4857-b499-0ea88b11d04e"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:10.040659 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-ea94d116-f008-4b31-840f-2649a5b9afae req-012901f5-8735-4c6e-8465-3cdaf9606205 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:10.041134 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-ea94d116-f008-4b31-840f-2649a5b9afae req-012901f5-8735-4c6e-8465-3cdaf9606205 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:10.056830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-ea94d116-f008-4b31-840f-2649a5b9afae req-012901f5-8735-4c6e-8465-3cdaf9606205 service nova] Creating event network-changed:72e53405-4f12-4857-b499-0ea88b11d04e for instance 080870aa-ea48-4010-a1cf-1fbf6c52b03e on hv-cinder-84327 Jun 15 14:48:10.063289 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-ea94d116-f008-4b31-840f-2649a5b9afae req-012901f5-8735-4c6e-8465-3cdaf9606205 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057346 Jun 15 14:48:10.064664 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 315/650] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:11.701529 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-1a087715-cc22-4ef2-b92b-9dc7519064d9 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:11.702084 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-1a087715-cc22-4ef2-b92b-9dc7519064d9 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:11.703985 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=29 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:11.708978 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1a087715-cc22-4ef2-b92b-9dc7519064d9 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:11.709512 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1a087715-cc22-4ef2-b92b-9dc7519064d9 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:11.710297 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1a087715-cc22-4ef2-b92b-9dc7519064d9 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:11.710734 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1a087715-cc22-4ef2-b92b-9dc7519064d9 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:11.728083 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:11.796886 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.objects.instance [None req-1a087715-cc22-4ef2-b92b-9dc7519064d9 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lazy-loading 'services' on Instance uuid 080870aa-ea48-4010-a1cf-1fbf6c52b03e {{(pid=124219) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:48:11.874759 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-1a087715-cc22-4ef2-b92b-9dc7519064d9 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "DELETE /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e/os-volume_attachments/d654f3b1-5b06-429e-b059-4ecd0feb8363" status: 202 len: 0 microversion: 2.1 time: 0.177536 Jun 15 14:48:11.875358 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 336/651] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Jun 15 14:48:11 2022] DELETE /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e/os-volume_attachments/d654f3b1-5b06-429e-b059-4ecd0feb8363 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:48:11.885344 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-f203cfac-346c-417d-9d9e-cc0a923804d8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:11.886520 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-f203cfac-346c-417d-9d9e-cc0a923804d8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:11.893100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f203cfac-346c-417d-9d9e-cc0a923804d8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:11.893558 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f203cfac-346c-417d-9d9e-cc0a923804d8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:11.894366 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f203cfac-346c-417d-9d9e-cc0a923804d8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:11.894879 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f203cfac-346c-417d-9d9e-cc0a923804d8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:11.928730 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-f203cfac-346c-417d-9d9e-cc0a923804d8 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048711 Jun 15 14:48:11.929449 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 316/652] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 14:48:11 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:12.079680 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-fe192890-ddd3-4520-8a1a-d88ce8dab8bc req-82ec5a0f-2a51-48cb-bce5-03a79a7124a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "080870aa-ea48-4010-a1cf-1fbf6c52b03e", "tag": "72e53405-4f12-4857-b499-0ea88b11d04e"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:12.088745 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-fe192890-ddd3-4520-8a1a-d88ce8dab8bc req-82ec5a0f-2a51-48cb-bce5-03a79a7124a9 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:12.089194 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-fe192890-ddd3-4520-8a1a-d88ce8dab8bc req-82ec5a0f-2a51-48cb-bce5-03a79a7124a9 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:12.100680 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-fe192890-ddd3-4520-8a1a-d88ce8dab8bc req-82ec5a0f-2a51-48cb-bce5-03a79a7124a9 service nova] Creating event network-changed:72e53405-4f12-4857-b499-0ea88b11d04e for instance 080870aa-ea48-4010-a1cf-1fbf6c52b03e on hv-cinder-84327 Jun 15 14:48:12.105619 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-fe192890-ddd3-4520-8a1a-d88ce8dab8bc req-82ec5a0f-2a51-48cb-bce5-03a79a7124a9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029962 Jun 15 14:48:12.106246 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 337/653] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:12.940596 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-eb0127d6-2cdc-4c37-9958-bb7220bc9514 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:12.941519 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-eb0127d6-2cdc-4c37-9958-bb7220bc9514 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:12.948307 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-eb0127d6-2cdc-4c37-9958-bb7220bc9514 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:12.948721 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-eb0127d6-2cdc-4c37-9958-bb7220bc9514 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:12.949483 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-eb0127d6-2cdc-4c37-9958-bb7220bc9514 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:12.949954 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-eb0127d6-2cdc-4c37-9958-bb7220bc9514 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:12.953729 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:12.983893 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-eb0127d6-2cdc-4c37-9958-bb7220bc9514 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047412 Jun 15 14:48:12.984505 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 317/654] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 14:48:12 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:13.242258 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 14:48:13.242446 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Wed Jun 15 14:48:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 14:48:13.626832 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-5a960d1d-9fa5-452e-8dd0-b28e355dc651 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fddacf2-4e45-4710-aca6-4157a311e44f"}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:13.628004 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-5a960d1d-9fa5-452e-8dd0-b28e355dc651 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:13.634298 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5a960d1d-9fa5-452e-8dd0-b28e355dc651 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:13.634753 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5a960d1d-9fa5-452e-8dd0-b28e355dc651 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:13.635521 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5a960d1d-9fa5-452e-8dd0-b28e355dc651 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:13.635964 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5a960d1d-9fa5-452e-8dd0-b28e355dc651 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:13.930758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-5a960d1d-9fa5-452e-8dd0-b28e355dc651 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "POST /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308709 Jun 15 14:48:13.931424 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 338/655] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 14:48:13 2022] POST /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:13.995386 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1bb8b8bf-8bb7-4c8a-a1a8-318203a3c9d9 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:13.996339 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1bb8b8bf-8bb7-4c8a-a1a8-318203a3c9d9 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:14.003538 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1bb8b8bf-8bb7-4c8a-a1a8-318203a3c9d9 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:14.003986 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1bb8b8bf-8bb7-4c8a-a1a8-318203a3c9d9 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:14.004744 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1bb8b8bf-8bb7-4c8a-a1a8-318203a3c9d9 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:14.005178 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1bb8b8bf-8bb7-4c8a-a1a8-318203a3c9d9 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:14.033914 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-1bb8b8bf-8bb7-4c8a-a1a8-318203a3c9d9 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042353 Jun 15 14:48:14.034465 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 318/656] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 14:48:13 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 14:48:14.045893 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-97d0c94b-8954-4b1e-8cc2-2ab9eb90a41a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:14.046431 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-97d0c94b-8954-4b1e-8cc2-2ab9eb90a41a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:14.053385 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-97d0c94b-8954-4b1e-8cc2-2ab9eb90a41a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:14.054046 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-97d0c94b-8954-4b1e-8cc2-2ab9eb90a41a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:14.054803 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-97d0c94b-8954-4b1e-8cc2-2ab9eb90a41a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:14.055236 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-97d0c94b-8954-4b1e-8cc2-2ab9eb90a41a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:14.133631 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-97d0c94b-8954-4b1e-8cc2-2ab9eb90a41a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] HTTP exception thrown: Instance 080870aa-ea48-4010-a1cf-1fbf6c52b03e is not attached to volume d654f3b1-5b06-429e-b059-4ecd0feb8363 Jun 15 14:48:14.143436 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-97d0c94b-8954-4b1e-8cc2-2ab9eb90a41a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Request method failure captured: Jun 15 14:48:14.143436 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: DELETE /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e/os-volume_attachments/d654f3b1-5b06-429e-b059-4ecd0feb8363 HTTP/1.1 Jun 15 14:48:14.143436 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:48:14.143436 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:48:14.143436 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:48:14.143436 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:48:14.143436 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:48:14.143436 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:48:14.143436 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:48:14.143436 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:48:14.143436 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfBAaTy2xw-Tfc45Wdoer_KaEpoNIyeDC4QzJsUhhku5vnI2hPlpHP5_qLH4v4u5luJKsokd0fW7PzyQ8onRbcPQ6ZB2qdaibwAHCItBiyK_NmcFtVzYRZP0gDVA9Bfz9kK6SWfd70mcYvDmagMkeYEWJF8usjvuRMLU5ZB34TeCi4I Jun 15 14:48:14.143436 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:48:14.143436 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:48:14.143436 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:48:14.143436 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:48:14.143436 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:48:14.143436 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:48:14.143436 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: f6fb5fc3024f428d9d052371dbe90737 Jun 15 14:48:14.143436 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-TestMinimumBasicScenario-432701430 Jun 15 14:48:14.143436 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:48:14.143436 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:48:14.145055 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f6fb5fc3024f428d9d052371dbe90737"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f6fb5fc3024f428d9d052371dbe90737", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f6fb5fc3024f428d9d052371dbe90737"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f6fb5fc3024f428d9d052371dbe90737"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:48:14.145055 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-TestMinimumBasicScenario-432701430 Jun 15 14:48:14.145055 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: f6fb5fc3024f428d9d052371dbe90737 Jun 15 14:48:14.145055 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-TestMinimumBasicScenario-432701430 Jun 15 14:48:14.145055 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-TestMinimumBasicScenario-432701430-project Jun 15 14:48:14.145055 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:48:14.145055 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:48:14.145055 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 163fb6502e0442c7aefc0c122ed4c035 Jun 15 14:48:14.145055 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-TestMinimumBasicScenario-432701430-project Jun 15 14:48:14.145055 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:48:14.145055 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Instance 080870aa-ea48-4010-a1cf-1fbf6c52b03e is not attached to volume d654f3b1-5b06-429e-b059-4ecd0feb8363 Jun 15 14:48:14.145885 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'server_id': '080870aa-ea48-4010-a1cf-1fbf6c52b03e', 'id': 'd654f3b1-5b06-429e-b059-4ecd0feb8363'} Jun 15 14:48:14.145885 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:48:14.145885 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:48:14.145885 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 15 14:48:14.145885 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 15 14:48:14.145885 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 14:48:14.145885 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 14:48:14.145885 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 15 14:48:14.145885 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 15 14:48:14.145885 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d654f3b1-5b06-429e-b059-4ecd0feb8363. Jun 15 14:48:14.145885 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:48:14.145885 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:48:14.145885 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:48:14.145885 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:48:14.145885 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:48:14.145885 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:48:14.145885 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:48:14.145885 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:48:14.145885 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:48:14.148190 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:48:14.148190 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 15 14:48:14.148190 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 15 14:48:14.148190 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 080870aa-ea48-4010-a1cf-1fbf6c52b03e is not attached to volume d654f3b1-5b06-429e-b059-4ecd0feb8363 Jun 15 14:48:14.148190 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:48:14.148190 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:48:14.148190 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:48:14.148190 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:48:14.148190 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:48:14.148190 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:48:14.148190 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:48:14.148190 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:48:14.148190 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 080870aa-ea48-4010-a1cf-1fbf6c52b03e is not attached to volume d654f3b1-5b06-429e-b059-4ecd0feb8363 Jun 15 14:48:14.148190 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:48:14.148190 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-97d0c94b-8954-4b1e-8cc2-2ab9eb90a41a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Returning 404 to user: Instance 080870aa-ea48-4010-a1cf-1fbf6c52b03e is not attached to volume d654f3b1-5b06-429e-b059-4ecd0feb8363 {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:48:14.149469 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-97d0c94b-8954-4b1e-8cc2-2ab9eb90a41a tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "DELETE /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e/os-volume_attachments/d654f3b1-5b06-429e-b059-4ecd0feb8363" status: 404 len: 154 microversion: 2.1 time: 0.103386 Jun 15 14:48:14.149469 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 339/657] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Jun 15 14:48:14 2022] DELETE /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e/os-volume_attachments/d654f3b1-5b06-429e-b059-4ecd0feb8363 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:48:16.332625 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-9ccfe378-bf44-4db1-99ae-d102060c62eb tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:16.333115 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-9ccfe378-bf44-4db1-99ae-d102060c62eb tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:16.335659 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=35 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:16.341009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9ccfe378-bf44-4db1-99ae-d102060c62eb tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:16.341459 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9ccfe378-bf44-4db1-99ae-d102060c62eb tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:16.342264 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9ccfe378-bf44-4db1-99ae-d102060c62eb tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:16.342705 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9ccfe378-bf44-4db1-99ae-d102060c62eb tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:16.368716 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-9ccfe378-bf44-4db1-99ae-d102060c62eb tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Going to try to terminate instance {{(pid=124220) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:48:16.454976 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-9ccfe378-bf44-4db1-99ae-d102060c62eb tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "DELETE /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 204 len: 0 microversion: 2.1 time: 0.125170 Jun 15 14:48:16.455195 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 319/658] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:48:16 2022] DELETE /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:48:16.463823 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-b69fec35-7d26-45b5-b1cd-1a677d49954b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:16.464424 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-b69fec35-7d26-45b5-b1cd-1a677d49954b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:16.471161 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b69fec35-7d26-45b5-b1cd-1a677d49954b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:16.471605 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b69fec35-7d26-45b5-b1cd-1a677d49954b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:16.472358 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b69fec35-7d26-45b5-b1cd-1a677d49954b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:16.472791 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b69fec35-7d26-45b5-b1cd-1a677d49954b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:16.606133 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b69fec35-7d26-45b5-b1cd-1a677d49954b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:16.613532 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-b69fec35-7d26-45b5-b1cd-1a677d49954b tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1555 microversion: 2.1 time: 0.154042 Jun 15 14:48:16.614120 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 340/659] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:16 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:48:17.634225 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-18aad985-8f16-478a-b078-028d3ef16026 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:17.634927 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-18aad985-8f16-478a-b078-028d3ef16026 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:17.641439 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-18aad985-8f16-478a-b078-028d3ef16026 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:17.641908 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-18aad985-8f16-478a-b078-028d3ef16026 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:17.642664 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-18aad985-8f16-478a-b078-028d3ef16026 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:17.643093 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-18aad985-8f16-478a-b078-028d3ef16026 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:17.773515 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-18aad985-8f16-478a-b078-028d3ef16026 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:17.780996 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-18aad985-8f16-478a-b078-028d3ef16026 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1555 microversion: 2.1 time: 0.153289 Jun 15 14:48:17.781566 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 320/660] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:17 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:18.798381 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-6dfbe726-aaa5-43e8-8c19-00ea06e72ea9 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:18.799006 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-6dfbe726-aaa5-43e8-8c19-00ea06e72ea9 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:18.806238 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6dfbe726-aaa5-43e8-8c19-00ea06e72ea9 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:18.806744 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6dfbe726-aaa5-43e8-8c19-00ea06e72ea9 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:18.807533 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6dfbe726-aaa5-43e8-8c19-00ea06e72ea9 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:18.807994 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6dfbe726-aaa5-43e8-8c19-00ea06e72ea9 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:18.936714 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-6dfbe726-aaa5-43e8-8c19-00ea06e72ea9 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:18.944272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-6dfbe726-aaa5-43e8-8c19-00ea06e72ea9 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1555 microversion: 2.1 time: 0.149765 Jun 15 14:48:18.944842 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 341/661] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:18 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:19.960341 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a0199281-b5c2-4192-831a-f53797f2507f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:19.960956 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a0199281-b5c2-4192-831a-f53797f2507f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:19.967484 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a0199281-b5c2-4192-831a-f53797f2507f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:19.967933 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a0199281-b5c2-4192-831a-f53797f2507f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:19.968694 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a0199281-b5c2-4192-831a-f53797f2507f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:19.969130 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a0199281-b5c2-4192-831a-f53797f2507f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:20.102146 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a0199281-b5c2-4192-831a-f53797f2507f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:20.110508 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a0199281-b5c2-4192-831a-f53797f2507f tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1555 microversion: 2.1 time: 0.153992 Jun 15 14:48:20.111080 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 321/662] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:19 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:20.424428 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-05ab45e0-8dec-4144-a3cc-3bcbf45e6e3c req-2ad85ea2-35b5-47de-a67b-8e158481d47e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "080870aa-ea48-4010-a1cf-1fbf6c52b03e", "name": "network-vif-deleted", "tag": "72e53405-4f12-4857-b499-0ea88b11d04e"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:20.438555 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-05ab45e0-8dec-4144-a3cc-3bcbf45e6e3c req-2ad85ea2-35b5-47de-a67b-8e158481d47e service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:20.439013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-05ab45e0-8dec-4144-a3cc-3bcbf45e6e3c req-2ad85ea2-35b5-47de-a67b-8e158481d47e service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:20.452316 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-05ab45e0-8dec-4144-a3cc-3bcbf45e6e3c req-2ad85ea2-35b5-47de-a67b-8e158481d47e service nova] Creating event network-vif-deleted:72e53405-4f12-4857-b499-0ea88b11d04e for instance 080870aa-ea48-4010-a1cf-1fbf6c52b03e on hv-cinder-84327 Jun 15 14:48:20.458207 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-05ab45e0-8dec-4144-a3cc-3bcbf45e6e3c req-2ad85ea2-35b5-47de-a67b-8e158481d47e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037429 Jun 15 14:48:20.458800 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 342/663] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:21.128492 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-94c8b12a-88a8-4547-bda2-586a0462a211 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:21.129091 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-94c8b12a-88a8-4547-bda2-586a0462a211 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:21.136244 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-94c8b12a-88a8-4547-bda2-586a0462a211 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:21.136682 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-94c8b12a-88a8-4547-bda2-586a0462a211 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:21.137433 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-94c8b12a-88a8-4547-bda2-586a0462a211 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:21.137894 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-94c8b12a-88a8-4547-bda2-586a0462a211 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:21.170076 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-94c8b12a-88a8-4547-bda2-586a0462a211 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:21.170516 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-94c8b12a-88a8-4547-bda2-586a0462a211 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:21.170959 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.objects.instance [None req-94c8b12a-88a8-4547-bda2-586a0462a211 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lazy-loading 'fault' on Instance uuid 080870aa-ea48-4010-a1cf-1fbf6c52b03e {{(pid=124220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:48:21.214935 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-94c8b12a-88a8-4547-bda2-586a0462a211 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:21.222655 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-94c8b12a-88a8-4547-bda2-586a0462a211 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1349 microversion: 2.1 time: 0.098088 Jun 15 14:48:21.223430 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 322/664] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:21 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:22.241064 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-d6f470a8-d935-47fa-9a82-c033ace16fc3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:22.241942 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-d6f470a8-d935-47fa-9a82-c033ace16fc3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:22.249641 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d6f470a8-d935-47fa-9a82-c033ace16fc3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:22.250125 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d6f470a8-d935-47fa-9a82-c033ace16fc3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:22.250916 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d6f470a8-d935-47fa-9a82-c033ace16fc3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:22.251357 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d6f470a8-d935-47fa-9a82-c033ace16fc3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:22.287981 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d6f470a8-d935-47fa-9a82-c033ace16fc3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:22.288427 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d6f470a8-d935-47fa-9a82-c033ace16fc3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:22.288882 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.objects.instance [None req-d6f470a8-d935-47fa-9a82-c033ace16fc3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lazy-loading 'fault' on Instance uuid 080870aa-ea48-4010-a1cf-1fbf6c52b03e {{(pid=124219) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:48:22.333359 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d6f470a8-d935-47fa-9a82-c033ace16fc3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163fb6502e0442c7aefc0c122ed4c035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fb5fc3024f428d9d052371dbe90737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:22.342231 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-d6f470a8-d935-47fa-9a82-c033ace16fc3 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 200 len: 1349 microversion: 2.1 time: 0.105339 Jun 15 14:48:22.342812 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 343/665] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:22 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 1349 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:22.943940 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 14:48:22.944142 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Wed Jun 15 14:48:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 14:48:23.360261 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-e9159134-18b2-4d17-8ba1-a1fa9a97a1e4 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:23.360870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-e9159134-18b2-4d17-8ba1-a1fa9a97a1e4 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] [instance: 080870aa-ea48-4010-a1cf-1fbf6c52b03e] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:23.367390 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e9159134-18b2-4d17-8ba1-a1fa9a97a1e4 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:23.367834 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e9159134-18b2-4d17-8ba1-a1fa9a97a1e4 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:23.368602 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e9159134-18b2-4d17-8ba1-a1fa9a97a1e4 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:23.369577 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e9159134-18b2-4d17-8ba1-a1fa9a97a1e4 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:23.386019 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.wsgi [None req-e9159134-18b2-4d17-8ba1-a1fa9a97a1e4 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] HTTP exception thrown: Instance 080870aa-ea48-4010-a1cf-1fbf6c52b03e could not be found. Jun 15 14:48:23.387631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-e9159134-18b2-4d17-8ba1-a1fa9a97a1e4 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Request method failure captured: Jun 15 14:48:23.387631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: request: GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e HTTP/1.1 Jun 15 14:48:23.387631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept: application/json Jun 15 14:48:23.387631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept-Encoding: identity Jun 15 14:48:23.387631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Connection: close Jun 15 14:48:23.387631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Length: 0 Jun 15 14:48:23.387631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Type: application/json Jun 15 14:48:23.387631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Host: 10.222.0.57 Jun 15 14:48:23.387631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Openstack-System-Scope: None Jun 15 14:48:23.387631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: User-Agent: python-urllib3/1.26.9 Jun 15 14:48:23.387631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Auth-Token: gAAAAABiqfBAaTy2xw-Tfc45Wdoer_KaEpoNIyeDC4QzJsUhhku5vnI2hPlpHP5_qLH4v4u5luJKsokd0fW7PzyQ8onRbcPQ6ZB2qdaibwAHCItBiyK_NmcFtVzYRZP0gDVA9Bfz9kK6SWfd70mcYvDmagMkeYEWJF8usjvuRMLU5ZB34TeCi4I Jun 15 14:48:23.387631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Id: None Jun 15 14:48:23.387631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Name: None Jun 15 14:48:23.387631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Identity-Status: Confirmed Jun 15 14:48:23.387631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Is-Admin-Project: True Jun 15 14:48:23.387631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Id: default Jun 15 14:48:23.387631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Name: Default Jun 15 14:48:23.387631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Id: f6fb5fc3024f428d9d052371dbe90737 Jun 15 14:48:23.387631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Name: tempest-TestMinimumBasicScenario-432701430 Jun 15 14:48:23.387631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Role: member,reader Jun 15 14:48:23.387631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Roles: member,reader Jun 15 14:48:23.389072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f6fb5fc3024f428d9d052371dbe90737"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f6fb5fc3024f428d9d052371dbe90737", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f6fb5fc3024f428d9d052371dbe90737"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f6fb5fc3024f428d9d052371dbe90737"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:48:23.389072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant: tempest-TestMinimumBasicScenario-432701430 Jun 15 14:48:23.389072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Id: f6fb5fc3024f428d9d052371dbe90737 Jun 15 14:48:23.389072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Name: tempest-TestMinimumBasicScenario-432701430 Jun 15 14:48:23.389072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User: tempest-TestMinimumBasicScenario-432701430-project Jun 15 14:48:23.389072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Id: default Jun 15 14:48:23.389072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Name: Default Jun 15 14:48:23.389072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Id: 163fb6502e0442c7aefc0c122ed4c035 Jun 15 14:48:23.389072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Name: tempest-TestMinimumBasicScenario-432701430-project Jun 15 14:48:23.389072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: method: > Jun 15 14:48:23.389072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: exception: Instance 080870aa-ea48-4010-a1cf-1fbf6c52b03e could not be found. Jun 15 14:48:23.389072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: action_args: {'id': '080870aa-ea48-4010-a1cf-1fbf6c52b03e'} Jun 15 14:48:23.389931 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:48:23.389931 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:48:23.389931 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:48:23.389931 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:48:23.389931 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:48:23.389931 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:48:23.389931 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:48:23.389931 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:48:23.389931 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:48:23.389931 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:48:23.389931 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 080870aa-ea48-4010-a1cf-1fbf6c52b03e could not be found. Jun 15 14:48:23.389931 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:48:23.389931 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:48:23.389931 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:48:23.389931 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:48:23.389931 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:48:23.389931 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:48:23.389931 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:48:23.389931 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:48:23.389931 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:48:23.391077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:48:23.391077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:48:23.391077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:48:23.391077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:48:23.391077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:48:23.391077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:48:23.391077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:48:23.391077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 080870aa-ea48-4010-a1cf-1fbf6c52b03e could not be found. Jun 15 14:48:23.391077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:48:23.391077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:48:23.391077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:48:23.391077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:48:23.391077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:48:23.391077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:48:23.391077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:48:23.391077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:48:23.391077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 080870aa-ea48-4010-a1cf-1fbf6c52b03e could not be found. Jun 15 14:48:23.391077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:48:23.392188 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-e9159134-18b2-4d17-8ba1-a1fa9a97a1e4 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Returning 404 to user: Instance 080870aa-ea48-4010-a1cf-1fbf6c52b03e could not be found. {{(pid=124220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:48:23.392188 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-e9159134-18b2-4d17-8ba1-a1fa9a97a1e4 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e" status: 404 len: 111 microversion: 2.1 time: 0.032696 Jun 15 14:48:23.392188 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 323/666] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:23 2022] GET /compute/v2.1/servers/080870aa-ea48-4010-a1cf-1fbf6c52b03e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:48:23.397479 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-fc9b7cfa-4d04-4d74-aded-ff243eb2a865 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] Calling method '.version_select at 0x7f8f13dd1f70>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:23.421099 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-fc9b7cfa-4d04-4d74-aded-ff243eb2a865 tempest-TestMinimumBasicScenario-432701430 tempest-TestMinimumBasicScenario-432701430-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1776512588" status: 202 len: 0 microversion: 2.1 time: 0.027330 Jun 15 14:48:23.421651 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 344/667] 10.222.0.57 () {58 vars in 1271 bytes} [Wed Jun 15 14:48:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1776512588 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:48:23.534329 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-fd3f9924-ab67-41e1-a060-491db3ac7b70 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:23.534868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-fd3f9924-ab67-41e1-a060-491db3ac7b70 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:23.542080 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fd3f9924-ab67-41e1-a060-491db3ac7b70 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:23.542640 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fd3f9924-ab67-41e1-a060-491db3ac7b70 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:23.543523 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fd3f9924-ab67-41e1-a060-491db3ac7b70 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:23.544096 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fd3f9924-ab67-41e1-a060-491db3ac7b70 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:23.568849 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.objects.instance [None req-fd3f9924-ab67-41e1-a060-491db3ac7b70 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lazy-loading 'flavor' on Instance uuid c7677949-b0c4-4f8a-bf16-26a4c639c344 {{(pid=124220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:48:23.699539 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-fd3f9924-ab67-41e1-a060-491db3ac7b70 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "POST /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344/action" status: 200 len: 32 microversion: 2.1 time: 0.169851 Jun 15 14:48:23.701720 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 324/668] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 14:48:23 2022] POST /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344/action => generated 32 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 14:48:23.767951 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-75c50a14-c4a4-4b08-8a9b-320d198d0aa2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:23.768700 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-75c50a14-c4a4-4b08-8a9b-320d198d0aa2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:23.778539 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-75c50a14-c4a4-4b08-8a9b-320d198d0aa2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:23.778996 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-75c50a14-c4a4-4b08-8a9b-320d198d0aa2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:23.779783 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-75c50a14-c4a4-4b08-8a9b-320d198d0aa2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:23.780350 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-75c50a14-c4a4-4b08-8a9b-320d198d0aa2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:23.984450 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-75c50a14-c4a4-4b08-8a9b-320d198d0aa2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:23.992573 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-75c50a14-c4a4-4b08-8a9b-320d198d0aa2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1734 microversion: 2.1 time: 0.287065 Jun 15 14:48:23.994306 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 345/669] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:23 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1734 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:25.012386 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a7bfa1e8-a3b8-4d01-8f2e-fee91b7e8f04 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:25.013100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a7bfa1e8-a3b8-4d01-8f2e-fee91b7e8f04 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:25.019685 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a7bfa1e8-a3b8-4d01-8f2e-fee91b7e8f04 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:25.020374 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a7bfa1e8-a3b8-4d01-8f2e-fee91b7e8f04 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:25.021166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a7bfa1e8-a3b8-4d01-8f2e-fee91b7e8f04 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:25.021612 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a7bfa1e8-a3b8-4d01-8f2e-fee91b7e8f04 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:25.467085 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a7bfa1e8-a3b8-4d01-8f2e-fee91b7e8f04 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:25.475149 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a7bfa1e8-a3b8-4d01-8f2e-fee91b7e8f04 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1734 microversion: 2.1 time: 0.467610 Jun 15 14:48:25.475715 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 325/670] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:25 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1734 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:26.493227 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-59cd8464-eef2-4100-8c31-e41b17f0f266 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:26.494342 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-59cd8464-eef2-4100-8c31-e41b17f0f266 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:26.501221 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-59cd8464-eef2-4100-8c31-e41b17f0f266 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:26.501688 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-59cd8464-eef2-4100-8c31-e41b17f0f266 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:26.502484 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-59cd8464-eef2-4100-8c31-e41b17f0f266 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:26.502926 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-59cd8464-eef2-4100-8c31-e41b17f0f266 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:26.652061 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-59cd8464-eef2-4100-8c31-e41b17f0f266 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:26.660335 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-59cd8464-eef2-4100-8c31-e41b17f0f266 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1734 microversion: 2.1 time: 0.170915 Jun 15 14:48:26.660936 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 346/671] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:26 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:27.676450 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-f6fa1f1b-132c-4943-b8e4-b25533e0620c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:27.677118 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-f6fa1f1b-132c-4943-b8e4-b25533e0620c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:27.683973 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f6fa1f1b-132c-4943-b8e4-b25533e0620c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:27.684428 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f6fa1f1b-132c-4943-b8e4-b25533e0620c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:27.685200 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f6fa1f1b-132c-4943-b8e4-b25533e0620c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:27.685644 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f6fa1f1b-132c-4943-b8e4-b25533e0620c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:27.818688 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-f6fa1f1b-132c-4943-b8e4-b25533e0620c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:27.827895 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-f6fa1f1b-132c-4943-b8e4-b25533e0620c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1734 microversion: 2.1 time: 0.155359 Jun 15 14:48:27.828458 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 326/672] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:27 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:28.844852 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-b3e7c6ec-8c9d-4047-b3a6-72d0382a1dd2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:28.845424 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-b3e7c6ec-8c9d-4047-b3a6-72d0382a1dd2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:28.851997 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b3e7c6ec-8c9d-4047-b3a6-72d0382a1dd2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:28.852449 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b3e7c6ec-8c9d-4047-b3a6-72d0382a1dd2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:28.853898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b3e7c6ec-8c9d-4047-b3a6-72d0382a1dd2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:28.854340 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b3e7c6ec-8c9d-4047-b3a6-72d0382a1dd2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:29.064249 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b3e7c6ec-8c9d-4047-b3a6-72d0382a1dd2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:29.072845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-b3e7c6ec-8c9d-4047-b3a6-72d0382a1dd2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1734 microversion: 2.1 time: 0.232059 Jun 15 14:48:29.074415 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 347/673] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:28 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1734 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:30.091751 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-f1b73066-b812-4a13-abe0-8f35e73443ae tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:30.092942 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-f1b73066-b812-4a13-abe0-8f35e73443ae tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:30.099002 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f1b73066-b812-4a13-abe0-8f35e73443ae tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:30.099693 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f1b73066-b812-4a13-abe0-8f35e73443ae tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:30.100670 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f1b73066-b812-4a13-abe0-8f35e73443ae tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:30.101121 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f1b73066-b812-4a13-abe0-8f35e73443ae tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:30.244974 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-f1b73066-b812-4a13-abe0-8f35e73443ae tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:30.254615 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-f1b73066-b812-4a13-abe0-8f35e73443ae tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1734 microversion: 2.1 time: 0.167169 Jun 15 14:48:30.255245 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 327/674] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:30 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:31.271485 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3f08b456-e015-4459-ba22-c90d06c90a08 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:31.272098 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-3f08b456-e015-4459-ba22-c90d06c90a08 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:31.278754 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3f08b456-e015-4459-ba22-c90d06c90a08 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:31.279209 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3f08b456-e015-4459-ba22-c90d06c90a08 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:31.279981 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3f08b456-e015-4459-ba22-c90d06c90a08 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:31.280421 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3f08b456-e015-4459-ba22-c90d06c90a08 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:31.435879 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-3f08b456-e015-4459-ba22-c90d06c90a08 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:31.447382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-3f08b456-e015-4459-ba22-c90d06c90a08 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1734 microversion: 2.1 time: 0.179583 Jun 15 14:48:31.448357 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 348/675] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:31 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:32.424066 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-586aa1ef-9764-468b-bab8-13a8b1e0569a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:32.424659 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-586aa1ef-9764-468b-bab8-13a8b1e0569a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:32.430725 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-586aa1ef-9764-468b-bab8-13a8b1e0569a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:32.431295 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-586aa1ef-9764-468b-bab8-13a8b1e0569a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:32.432157 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-586aa1ef-9764-468b-bab8-13a8b1e0569a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:32.432597 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-586aa1ef-9764-468b-bab8-13a8b1e0569a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:32.463878 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-586aa1ef-9764-468b-bab8-13a8b1e0569a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0/os-volume_attachments/f044674c-a1de-4998-a465-df6831ec1756" status: 200 len: 194 microversion: 2.20 time: 0.265522 Jun 15 14:48:32.464379 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 328/676] 10.222.0.57 () {60 vars in 1453 bytes} [Wed Jun 15 14:48:32 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0/os-volume_attachments/f044674c-a1de-4998-a465-df6831ec1756 => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:48:32.465379 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-05ad9485-fcdc-4e7d-8ff3-f5c42801acf2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:32.466125 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-05ad9485-fcdc-4e7d-8ff3-f5c42801acf2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:32.472986 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-05ad9485-fcdc-4e7d-8ff3-f5c42801acf2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:32.473442 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-05ad9485-fcdc-4e7d-8ff3-f5c42801acf2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:32.474235 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-05ad9485-fcdc-4e7d-8ff3-f5c42801acf2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:32.474673 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-05ad9485-fcdc-4e7d-8ff3-f5c42801acf2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:32.528261 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-317fc807-0bb5-45d8-bd99-fee2de9c535a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:32.528763 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-317fc807-0bb5-45d8-bd99-fee2de9c535a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:32.534851 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-317fc807-0bb5-45d8-bd99-fee2de9c535a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:32.535309 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-317fc807-0bb5-45d8-bd99-fee2de9c535a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:32.536083 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-317fc807-0bb5-45d8-bd99-fee2de9c535a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:32.536520 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-317fc807-0bb5-45d8-bd99-fee2de9c535a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:32.607721 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-05ad9485-fcdc-4e7d-8ff3-f5c42801acf2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:32.616182 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-05ad9485-fcdc-4e7d-8ff3-f5c42801acf2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1734 microversion: 2.1 time: 0.155818 Jun 15 14:48:32.616746 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 349/677] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:32 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:48:32.660616 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.objects.instance [None req-317fc807-0bb5-45d8-bd99-fee2de9c535a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lazy-loading 'services' on Instance uuid 123ea48b-cb21-429c-85c6-0ae71d51c1c0 {{(pid=124220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:48:32.762979 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:32.774735 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-317fc807-0bb5-45d8-bd99-fee2de9c535a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "DELETE /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0/os-volume_attachments/f044674c-a1de-4998-a465-df6831ec1756" status: 202 len: 0 microversion: 2.20 time: 0.251078 Jun 15 14:48:32.775960 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 329/678] 10.222.0.57 () {60 vars in 1456 bytes} [Wed Jun 15 14:48:32 2022] DELETE /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0/os-volume_attachments/f044674c-a1de-4998-a465-df6831ec1756 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 15 14:48:32.784509 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-8828efd6-5129-4039-8f38-88ee5302d058 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:32.785600 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-8828efd6-5129-4039-8f38-88ee5302d058 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:32.792236 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8828efd6-5129-4039-8f38-88ee5302d058 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:32.792696 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8828efd6-5129-4039-8f38-88ee5302d058 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:32.793522 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8828efd6-5129-4039-8f38-88ee5302d058 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:32.794059 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8828efd6-5129-4039-8f38-88ee5302d058 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:32.827385 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-8828efd6-5129-4039-8f38-88ee5302d058 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046907 Jun 15 14:48:32.827955 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 350/679] 10.222.0.57 () {60 vars in 1342 bytes} [Wed Jun 15 14:48:32 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:48:33.636009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6914e3b5-0e4a-4f6c-ba71-24c7d28bcdce tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:33.636755 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6914e3b5-0e4a-4f6c-ba71-24c7d28bcdce tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:33.644271 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6914e3b5-0e4a-4f6c-ba71-24c7d28bcdce tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:33.644729 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6914e3b5-0e4a-4f6c-ba71-24c7d28bcdce tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:33.645507 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6914e3b5-0e4a-4f6c-ba71-24c7d28bcdce tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:33.645981 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6914e3b5-0e4a-4f6c-ba71-24c7d28bcdce tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:33.778281 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6914e3b5-0e4a-4f6c-ba71-24c7d28bcdce tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:33.786679 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-6914e3b5-0e4a-4f6c-ba71-24c7d28bcdce tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1734 microversion: 2.1 time: 0.157078 Jun 15 14:48:33.787227 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 330/680] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:33 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:33.839947 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-a3d2c1a0-ec41-4d14-bca7-2e0d459323fb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:33.840860 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-a3d2c1a0-ec41-4d14-bca7-2e0d459323fb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:33.847488 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a3d2c1a0-ec41-4d14-bca7-2e0d459323fb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:33.847936 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a3d2c1a0-ec41-4d14-bca7-2e0d459323fb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:33.848695 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a3d2c1a0-ec41-4d14-bca7-2e0d459323fb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:33.849131 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a3d2c1a0-ec41-4d14-bca7-2e0d459323fb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:33.880303 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-a3d2c1a0-ec41-4d14-bca7-2e0d459323fb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045162 Jun 15 14:48:33.880848 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 351/681] 10.222.0.57 () {60 vars in 1342 bytes} [Wed Jun 15 14:48:33 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:48:34.804367 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-305fb9fa-6cc5-4e31-b570-6ffa8e523922 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:34.805034 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-305fb9fa-6cc5-4e31-b570-6ffa8e523922 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:34.812177 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-305fb9fa-6cc5-4e31-b570-6ffa8e523922 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:34.812623 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-305fb9fa-6cc5-4e31-b570-6ffa8e523922 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:34.813418 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-305fb9fa-6cc5-4e31-b570-6ffa8e523922 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:34.813883 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-305fb9fa-6cc5-4e31-b570-6ffa8e523922 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:34.892094 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-05c4e0a5-36bb-4c67-bc41-3babceaddf97 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:34.893009 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-05c4e0a5-36bb-4c67-bc41-3babceaddf97 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:34.899573 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-05c4e0a5-36bb-4c67-bc41-3babceaddf97 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:34.900051 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-05c4e0a5-36bb-4c67-bc41-3babceaddf97 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:34.900818 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-05c4e0a5-36bb-4c67-bc41-3babceaddf97 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:34.901258 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-05c4e0a5-36bb-4c67-bc41-3babceaddf97 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:34.925895 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:34.930381 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-05c4e0a5-36bb-4c67-bc41-3babceaddf97 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042390 Jun 15 14:48:34.930942 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 352/682] 10.222.0.57 () {60 vars in 1342 bytes} [Wed Jun 15 14:48:34 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:34.945572 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-305fb9fa-6cc5-4e31-b570-6ffa8e523922 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:34.954827 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-305fb9fa-6cc5-4e31-b570-6ffa8e523922 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1734 microversion: 2.1 time: 0.154243 Jun 15 14:48:34.955397 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 331/683] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:34 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:34.989907 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-8f313a75-1b00-4560-8039-8936e3f075dc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:34.990411 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-8f313a75-1b00-4560-8039-8936e3f075dc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:34.997865 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8f313a75-1b00-4560-8039-8936e3f075dc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:34.998321 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8f313a75-1b00-4560-8039-8936e3f075dc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:34.999085 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8f313a75-1b00-4560-8039-8936e3f075dc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:34.999524 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8f313a75-1b00-4560-8039-8936e3f075dc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:35.023623 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-8f313a75-1b00-4560-8039-8936e3f075dc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Going to try to terminate instance {{(pid=124219) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:48:35.097617 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-8f313a75-1b00-4560-8039-8936e3f075dc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "DELETE /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 204 len: 0 microversion: 2.20 time: 0.112068 Jun 15 14:48:35.098356 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 353/684] 10.222.0.57 () {60 vars in 1279 bytes} [Wed Jun 15 14:48:34 2022] DELETE /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 14:48:35.107712 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-36d087e2-fae9-4bd9-9736-a6e645e31654 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:35.108357 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-36d087e2-fae9-4bd9-9736-a6e645e31654 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:35.114242 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-36d087e2-fae9-4bd9-9736-a6e645e31654 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:35.114687 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-36d087e2-fae9-4bd9-9736-a6e645e31654 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:35.115441 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-36d087e2-fae9-4bd9-9736-a6e645e31654 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:35.115868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-36d087e2-fae9-4bd9-9736-a6e645e31654 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:35.245375 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-36d087e2-fae9-4bd9-9736-a6e645e31654 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:35.253181 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-36d087e2-fae9-4bd9-9736-a6e645e31654 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:35.254699 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-36d087e2-fae9-4bd9-9736-a6e645e31654 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:35.255857 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-36d087e2-fae9-4bd9-9736-a6e645e31654 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.153424 Jun 15 14:48:35.256392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 332/685] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:48:35 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:48:35.973155 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-b6e2fc6e-ee1b-46d6-bb5c-e26efe4b85ac tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:35.973987 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-b6e2fc6e-ee1b-46d6-bb5c-e26efe4b85ac tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:35.980491 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b6e2fc6e-ee1b-46d6-bb5c-e26efe4b85ac tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:35.980943 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b6e2fc6e-ee1b-46d6-bb5c-e26efe4b85ac tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:35.981728 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b6e2fc6e-ee1b-46d6-bb5c-e26efe4b85ac tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:35.982173 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b6e2fc6e-ee1b-46d6-bb5c-e26efe4b85ac tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:36.110861 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b6e2fc6e-ee1b-46d6-bb5c-e26efe4b85ac tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:36.119718 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-b6e2fc6e-ee1b-46d6-bb5c-e26efe4b85ac tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1734 microversion: 2.1 time: 0.150200 Jun 15 14:48:36.120069 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 354/686] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:35 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:36.274589 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-3f9eeae8-c84c-4534-9b93-0e4b3d9845af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:36.275279 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-3f9eeae8-c84c-4534-9b93-0e4b3d9845af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:36.281851 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3f9eeae8-c84c-4534-9b93-0e4b3d9845af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:36.282291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3f9eeae8-c84c-4534-9b93-0e4b3d9845af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:36.283038 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3f9eeae8-c84c-4534-9b93-0e4b3d9845af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:36.283493 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3f9eeae8-c84c-4534-9b93-0e4b3d9845af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:36.423949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-3f9eeae8-c84c-4534-9b93-0e4b3d9845af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:36.432932 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-3f9eeae8-c84c-4534-9b93-0e4b3d9845af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:36.434504 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-3f9eeae8-c84c-4534-9b93-0e4b3d9845af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:36.435700 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-3f9eeae8-c84c-4534-9b93-0e4b3d9845af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.165008 Jun 15 14:48:36.436252 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 333/687] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:48:36 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:48:37.136748 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-8dde0c76-4582-41c8-9063-f71fd4dd37dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:37.137400 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-8dde0c76-4582-41c8-9063-f71fd4dd37dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:37.144229 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8dde0c76-4582-41c8-9063-f71fd4dd37dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:37.144710 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8dde0c76-4582-41c8-9063-f71fd4dd37dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:37.145469 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8dde0c76-4582-41c8-9063-f71fd4dd37dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:37.145934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8dde0c76-4582-41c8-9063-f71fd4dd37dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:37.292758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-8dde0c76-4582-41c8-9063-f71fd4dd37dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:37.301005 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-8dde0c76-4582-41c8-9063-f71fd4dd37dd tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1734 microversion: 2.1 time: 0.168264 Jun 15 14:48:37.301632 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 355/688] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:37 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:37.454952 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-ea5ab889-7955-4823-8cbb-080e8e4ee6e2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:37.455924 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-ea5ab889-7955-4823-8cbb-080e8e4ee6e2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:37.462177 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ea5ab889-7955-4823-8cbb-080e8e4ee6e2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:37.463187 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ea5ab889-7955-4823-8cbb-080e8e4ee6e2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:37.463959 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ea5ab889-7955-4823-8cbb-080e8e4ee6e2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:37.464397 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ea5ab889-7955-4823-8cbb-080e8e4ee6e2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:37.592696 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ea5ab889-7955-4823-8cbb-080e8e4ee6e2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:37.600785 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ea5ab889-7955-4823-8cbb-080e8e4ee6e2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:37.602302 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ea5ab889-7955-4823-8cbb-080e8e4ee6e2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:37.603511 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-ea5ab889-7955-4823-8cbb-080e8e4ee6e2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.152848 Jun 15 14:48:37.604164 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 334/689] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:48:37 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:48:38.318952 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-1a61e770-85e1-4473-9a37-1900dacdda74 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:38.319563 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-1a61e770-85e1-4473-9a37-1900dacdda74 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:38.326421 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1a61e770-85e1-4473-9a37-1900dacdda74 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:38.326874 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1a61e770-85e1-4473-9a37-1900dacdda74 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:38.327658 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1a61e770-85e1-4473-9a37-1900dacdda74 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:38.328189 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1a61e770-85e1-4473-9a37-1900dacdda74 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:38.621787 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-e120c645-6432-4bd6-a8d3-b43fb340f9bf tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:38.622401 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-e120c645-6432-4bd6-a8d3-b43fb340f9bf tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:38.629230 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e120c645-6432-4bd6-a8d3-b43fb340f9bf tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:38.629709 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e120c645-6432-4bd6-a8d3-b43fb340f9bf tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:38.630488 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e120c645-6432-4bd6-a8d3-b43fb340f9bf tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:38.630932 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e120c645-6432-4bd6-a8d3-b43fb340f9bf tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:38.667139 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-1a61e770-85e1-4473-9a37-1900dacdda74 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:38.675512 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-1a61e770-85e1-4473-9a37-1900dacdda74 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1734 microversion: 2.1 time: 0.360480 Jun 15 14:48:38.676102 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 356/690] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:38 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1734 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:48:38.778272 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e120c645-6432-4bd6-a8d3-b43fb340f9bf tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:38.788423 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e120c645-6432-4bd6-a8d3-b43fb340f9bf tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:38.791210 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e120c645-6432-4bd6-a8d3-b43fb340f9bf tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:38.792885 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-e120c645-6432-4bd6-a8d3-b43fb340f9bf tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 200 len: 1723 microversion: 2.20 time: 0.175018 Jun 15 14:48:38.793721 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 335/691] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:48:38 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:48:39.103325 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-e1fea78e-4822-47e8-a139-02d5a5ae800a req-972a4203-7304-4908-9cf5-b84b8af82fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123ea48b-cb21-429c-85c6-0ae71d51c1c0", "name": "network-vif-deleted", "tag": "3b30c106-589d-4777-be4f-8c3b882d514e"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:39.113014 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-e1fea78e-4822-47e8-a139-02d5a5ae800a req-972a4203-7304-4908-9cf5-b84b8af82fe7 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:39.113014 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-e1fea78e-4822-47e8-a139-02d5a5ae800a req-972a4203-7304-4908-9cf5-b84b8af82fe7 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:39.124031 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-e1fea78e-4822-47e8-a139-02d5a5ae800a req-972a4203-7304-4908-9cf5-b84b8af82fe7 service nova] Creating event network-vif-deleted:3b30c106-589d-4777-be4f-8c3b882d514e for instance 123ea48b-cb21-429c-85c6-0ae71d51c1c0 on hv-cinder-84327 Jun 15 14:48:39.128997 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-e1fea78e-4822-47e8-a139-02d5a5ae800a req-972a4203-7304-4908-9cf5-b84b8af82fe7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095867 Jun 15 14:48:39.129713 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 357/692] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:39.694318 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-d46d8394-832b-48e8-bd30-a67905a9ec8f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:39.695861 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-d46d8394-832b-48e8-bd30-a67905a9ec8f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:39.704798 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d46d8394-832b-48e8-bd30-a67905a9ec8f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:39.705630 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d46d8394-832b-48e8-bd30-a67905a9ec8f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:39.706537 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d46d8394-832b-48e8-bd30-a67905a9ec8f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:39.707212 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d46d8394-832b-48e8-bd30-a67905a9ec8f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:39.813758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-8403f3ef-dfd4-4f27-8f72-554f7b0c1774 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:39.814458 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-8403f3ef-dfd4-4f27-8f72-554f7b0c1774 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:39.825157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8403f3ef-dfd4-4f27-8f72-554f7b0c1774 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:39.825585 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8403f3ef-dfd4-4f27-8f72-554f7b0c1774 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:39.826480 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8403f3ef-dfd4-4f27-8f72-554f7b0c1774 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:39.826812 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8403f3ef-dfd4-4f27-8f72-554f7b0c1774 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:39.842962 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-8403f3ef-dfd4-4f27-8f72-554f7b0c1774 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] HTTP exception thrown: Instance 123ea48b-cb21-429c-85c6-0ae71d51c1c0 could not be found. Jun 15 14:48:39.844649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-8403f3ef-dfd4-4f27-8f72-554f7b0c1774 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Request method failure captured: Jun 15 14:48:39.844649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 HTTP/1.1 Jun 15 14:48:39.844649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:48:39.844649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:48:39.844649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:48:39.844649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:48:39.844649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:48:39.844649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:48:39.844649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:48:39.844649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:48:39.844649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfAA0mnjUk175IWqfAnuySq8diJuJh9uxnkwWapaH-5-FMWzBuA5NVj9WboUQ-ufMSuLPkzWCRQ0mIiojDDYwthrSu-gA9a-X4dPJrTHNRu1qaTcVuKHRzG1UZWR1d5E5u7spbhsaL-BHv6MvelnUqazpvOiB3dPVF-4UFF45gZJBYk Jun 15 14:48:39.844649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:48:39.844649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:48:39.844649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:48:39.844649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:48:39.844649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 14:48:39.844649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:48:39.844649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:48:39.844649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 4bf1cdbd5dc9471f9f1732600ab98c24 Jun 15 14:48:39.844649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1247917787 Jun 15 14:48:39.844649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:48:39.844649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:48:39.846484 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4bf1cdbd5dc9471f9f1732600ab98c24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4bf1cdbd5dc9471f9f1732600ab98c24", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4bf1cdbd5dc9471f9f1732600ab98c24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4bf1cdbd5dc9471f9f1732600ab98c24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:48:39.846484 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1247917787 Jun 15 14:48:39.846484 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 4bf1cdbd5dc9471f9f1732600ab98c24 Jun 15 14:48:39.846484 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1247917787 Jun 15 14:48:39.846484 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-AttachVolumeShelveTestJSON-1247917787-project Jun 15 14:48:39.846484 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:48:39.846484 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:48:39.846484 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 1d58ac7f49454fd6a5b5eef6a1e8b2d8 Jun 15 14:48:39.846484 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1247917787-project Jun 15 14:48:39.846484 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:48:39.846484 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Instance 123ea48b-cb21-429c-85c6-0ae71d51c1c0 could not be found. Jun 15 14:48:39.846484 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': '123ea48b-cb21-429c-85c6-0ae71d51c1c0'} Jun 15 14:48:39.850866 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:48:39.850866 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:48:39.850866 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:48:39.850866 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:48:39.850866 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:48:39.850866 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:48:39.850866 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:48:39.850866 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:48:39.850866 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:48:39.850866 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:48:39.850866 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 123ea48b-cb21-429c-85c6-0ae71d51c1c0 could not be found. Jun 15 14:48:39.850866 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:48:39.850866 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:48:39.850866 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:48:39.850866 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:48:39.850866 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:48:39.850866 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:48:39.850866 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:48:39.850866 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:48:39.850866 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:48:39.852425 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:48:39.852425 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:48:39.852425 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:48:39.852425 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:48:39.852425 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:48:39.852425 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:48:39.852425 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:48:39.852425 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 123ea48b-cb21-429c-85c6-0ae71d51c1c0 could not be found. Jun 15 14:48:39.852425 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:48:39.852425 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:48:39.852425 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:48:39.852425 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:48:39.852425 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:48:39.852425 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:48:39.852425 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:48:39.852425 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:48:39.852425 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 123ea48b-cb21-429c-85c6-0ae71d51c1c0 could not be found. Jun 15 14:48:39.852425 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:48:39.855734 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-8403f3ef-dfd4-4f27-8f72-554f7b0c1774 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Returning 404 to user: Instance 123ea48b-cb21-429c-85c6-0ae71d51c1c0 could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:48:39.855734 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-8403f3ef-dfd4-4f27-8f72-554f7b0c1774 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 404 len: 111 microversion: 2.20 time: 0.038883 Jun 15 14:48:39.855734 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 358/693] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:48:39 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 15 14:48:39.856044 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-d46d8394-832b-48e8-bd30-a67905a9ec8f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:39.856202 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-ebcb6182-3a93-4a79-8e7c-427a083f5088 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '.version_select at 0x7f8f13ef68b0>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:39.863580 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-d46d8394-832b-48e8-bd30-a67905a9ec8f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1734 microversion: 2.1 time: 0.174620 Jun 15 14:48:39.864502 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 336/694] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:39 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:39.877787 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-ebcb6182-3a93-4a79-8e7c-427a083f5088 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-62574201" status: 204 len: 0 microversion: 2.20 time: 0.026374 Jun 15 14:48:39.878361 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 359/695] 10.222.0.57 () {60 vars in 1255 bytes} [Wed Jun 15 14:48:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-62574201 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 15 14:48:40.542008 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-270853c9-986a-47d4-9d7a-c7b01c3cbb33 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Action: 'create', calling method: .version_select at 0x7f8f134d1430>, body: {"keypair": {"name": "tempest-keypair-1240190059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKhEKVffiUpHjDYOwMT3dfYduowcTVYUQMNUuqaRoxjWL0R02Xs29iaT4r7J4sAPFbslZ9/422S3b06hTkJF2M02q5EKHtaoJMoG+cH21EXGVB8lP0mlXqrMVlIEe6UtA=="}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:40.555615 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-270853c9-986a-47d4-9d7a-c7b01c3cbb33 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Getting quotas for project 4bf1cdbd5dc9471f9f1732600ab98c24. Resources: {'key_pairs'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:48:40.559975 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-270853c9-986a-47d4-9d7a-c7b01c3cbb33 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Getting quotas for user 1d58ac7f49454fd6a5b5eef6a1e8b2d8 and project 4bf1cdbd5dc9471f9f1732600ab98c24. Resources: {'key_pairs'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:48:40.584785 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-270853c9-986a-47d4-9d7a-c7b01c3cbb33 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046884 Jun 15 14:48:40.585369 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 337/696] 10.222.0.57 () {62 vars in 1199 bytes} [Wed Jun 15 14:48:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 15 14:48:40.882541 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-fc554291-a859-464a-9c21-dfd4e31d717a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:40.883152 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-fc554291-a859-464a-9c21-dfd4e31d717a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:40.892795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fc554291-a859-464a-9c21-dfd4e31d717a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:40.893285 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fc554291-a859-464a-9c21-dfd4e31d717a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:40.894026 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fc554291-a859-464a-9c21-dfd4e31d717a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:40.894459 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fc554291-a859-464a-9c21-dfd4e31d717a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:41.057138 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-fc554291-a859-464a-9c21-dfd4e31d717a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:41.065194 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-fc554291-a859-464a-9c21-dfd4e31d717a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1734 microversion: 2.1 time: 0.186895 Jun 15 14:48:41.065982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 360/697] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:40 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1734 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:41.848827 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-91225e76-edab-4cac-975d-bcdf62ccc9d1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-963537285", "imageRef": "e18802bf-9dac-462c-88ba-5cce79043279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "144e5733-1650-4b80-90c9-abe595a9b128"}], "security_groups": [{"name": "tempest-securitygroup--2830152"}], "key_name": "tempest-keypair-1240190059", "user_data": "}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:41.953062 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.network.neutron [None req-91225e76-edab-4cac-975d-bcdf62ccc9d1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] validate_networks() for [('144e5733-1650-4b80-90c9-abe595a9b128', None, None, None, None, None)] {{(pid=124220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:48:42.082062 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3093de1f-c7f6-4f9e-be24-ad9e621bd0c9 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:42.082680 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-3093de1f-c7f6-4f9e-be24-ad9e621bd0c9 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:42.085055 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:42.092412 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3093de1f-c7f6-4f9e-be24-ad9e621bd0c9 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:42.092863 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3093de1f-c7f6-4f9e-be24-ad9e621bd0c9 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:42.093645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3093de1f-c7f6-4f9e-be24-ad9e621bd0c9 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:42.094100 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3093de1f-c7f6-4f9e-be24-ad9e621bd0c9 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:42.225490 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-3093de1f-c7f6-4f9e-be24-ad9e621bd0c9 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:42.236857 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-3093de1f-c7f6-4f9e-be24-ad9e621bd0c9 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1734 microversion: 2.1 time: 0.158411 Jun 15 14:48:42.237421 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 361/698] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:42 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:48:42.412335 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-91225e76-edab-4cac-975d-bcdf62ccc9d1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Flavor limits 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:48:42.412789 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-91225e76-edab-4cac-975d-bcdf62ccc9d1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Image limits 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:48:42.413266 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-91225e76-edab-4cac-975d-bcdf62ccc9d1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Flavor pref 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:48:42.413702 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-91225e76-edab-4cac-975d-bcdf62ccc9d1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Image pref 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:48:42.414154 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-91225e76-edab-4cac-975d-bcdf62ccc9d1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:48:42.423115 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-91225e76-edab-4cac-975d-bcdf62ccc9d1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:42.423637 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-91225e76-edab-4cac-975d-bcdf62ccc9d1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:42.424494 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-91225e76-edab-4cac-975d-bcdf62ccc9d1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:42.425338 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-91225e76-edab-4cac-975d-bcdf62ccc9d1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:42.443582 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-91225e76-edab-4cac-975d-bcdf62ccc9d1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Getting quotas for project 4bf1cdbd5dc9471f9f1732600ab98c24. Resources: {'cores', 'instances', 'ram'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:48:42.448596 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-91225e76-edab-4cac-975d-bcdf62ccc9d1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Getting quotas for user 1d58ac7f49454fd6a5b5eef6a1e8b2d8 and project 4bf1cdbd5dc9471f9f1732600ab98c24. Resources: {'cores', 'instances', 'ram'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:48:42.460028 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-91225e76-edab-4cac-975d-bcdf62ccc9d1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Going to run 1 instances... {{(pid=124220) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:48:42.462263 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-91225e76-edab-4cac-975d-bcdf62ccc9d1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e18802bf-9dac-462c-88ba-5cce79043279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:48:42.508932 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-91225e76-edab-4cac-975d-bcdf62ccc9d1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.665161 Jun 15 14:48:42.509779 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 338/699] 10.222.0.57 () {62 vars in 1187 bytes} [Wed Jun 15 14:48:41 2022] POST /compute/v2.1/servers => generated 399 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 15 14:48:42.519556 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-dd6fbe60-2771-4e6e-a869-1df2e18d426e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:42.520155 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-dd6fbe60-2771-4e6e-a869-1df2e18d426e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:42.577155 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-dd6fbe60-2771-4e6e-a869-1df2e18d426e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:42.584347 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-dd6fbe60-2771-4e6e-a869-1df2e18d426e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:42.585923 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-dd6fbe60-2771-4e6e-a869-1df2e18d426e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:42.587053 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-dd6fbe60-2771-4e6e-a869-1df2e18d426e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1281 microversion: 2.20 time: 0.071368 Jun 15 14:48:42.587750 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 362/700] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:48:42 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:48:43.255064 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1f51454d-0549-4c71-b395-c5b72ca925d0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:43.255684 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1f51454d-0549-4c71-b395-c5b72ca925d0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:43.263722 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1f51454d-0549-4c71-b395-c5b72ca925d0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:43.264178 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1f51454d-0549-4c71-b395-c5b72ca925d0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:43.264961 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1f51454d-0549-4c71-b395-c5b72ca925d0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:43.265402 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1f51454d-0549-4c71-b395-c5b72ca925d0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:43.400699 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-1f51454d-0549-4c71-b395-c5b72ca925d0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:43.408675 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-1f51454d-0549-4c71-b395-c5b72ca925d0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1734 microversion: 2.1 time: 0.157994 Jun 15 14:48:43.409246 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 339/701] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:43 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:43.605542 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-5a2bc0e9-d618-4e5b-bfab-80f01dc3aeec tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:43.606188 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-5a2bc0e9-d618-4e5b-bfab-80f01dc3aeec tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:43.612691 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5a2bc0e9-d618-4e5b-bfab-80f01dc3aeec tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:43.613177 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5a2bc0e9-d618-4e5b-bfab-80f01dc3aeec tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:43.613969 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5a2bc0e9-d618-4e5b-bfab-80f01dc3aeec tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:43.614412 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5a2bc0e9-d618-4e5b-bfab-80f01dc3aeec tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:43.678301 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-5a2bc0e9-d618-4e5b-bfab-80f01dc3aeec tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:43.686971 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-5a2bc0e9-d618-4e5b-bfab-80f01dc3aeec tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:43.688468 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-5a2bc0e9-d618-4e5b-bfab-80f01dc3aeec tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:43.689574 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-5a2bc0e9-d618-4e5b-bfab-80f01dc3aeec tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1333 microversion: 2.20 time: 0.087969 Jun 15 14:48:43.690158 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 363/702] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:48:43 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1333 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:48:44.426572 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-9818ed5b-0a22-42a4-9610-1bc2e7d3cc07 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:44.427210 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-9818ed5b-0a22-42a4-9610-1bc2e7d3cc07 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:44.433955 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9818ed5b-0a22-42a4-9610-1bc2e7d3cc07 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:44.434411 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9818ed5b-0a22-42a4-9610-1bc2e7d3cc07 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:44.435180 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9818ed5b-0a22-42a4-9610-1bc2e7d3cc07 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:44.435613 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9818ed5b-0a22-42a4-9610-1bc2e7d3cc07 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:44.709442 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-ddfaadf2-c022-4a93-9ba1-19e793bebeb8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:44.710777 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-ddfaadf2-c022-4a93-9ba1-19e793bebeb8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:44.721118 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ddfaadf2-c022-4a93-9ba1-19e793bebeb8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:44.721608 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ddfaadf2-c022-4a93-9ba1-19e793bebeb8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:44.722463 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ddfaadf2-c022-4a93-9ba1-19e793bebeb8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:44.722928 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ddfaadf2-c022-4a93-9ba1-19e793bebeb8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:44.838352 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9818ed5b-0a22-42a4-9610-1bc2e7d3cc07 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:44.847447 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-9818ed5b-0a22-42a4-9610-1bc2e7d3cc07 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1734 microversion: 2.1 time: 0.425152 Jun 15 14:48:44.855040 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 340/703] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:44 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1734 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:44.981281 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-ddfaadf2-c022-4a93-9ba1-19e793bebeb8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:44.989285 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-ddfaadf2-c022-4a93-9ba1-19e793bebeb8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:44.990913 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-ddfaadf2-c022-4a93-9ba1-19e793bebeb8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:44.992123 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-ddfaadf2-c022-4a93-9ba1-19e793bebeb8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1404 microversion: 2.20 time: 0.287143 Jun 15 14:48:44.992760 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 364/704] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:48:44 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1404 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:48:45.403388 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-f0b90b46-f77e-447e-b82a-b57b19bbac96 req-5eccd111-c197-48fc-a4f3-12d9025cac1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d0cbdc8-d87b-4ce4-97d1-59aca342287a", "tag": "bf1963f9-4d7c-4562-9c53-6c53a728e8c6"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:45.412393 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-f0b90b46-f77e-447e-b82a-b57b19bbac96 req-5eccd111-c197-48fc-a4f3-12d9025cac1d service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:45.412838 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-f0b90b46-f77e-447e-b82a-b57b19bbac96 req-5eccd111-c197-48fc-a4f3-12d9025cac1d service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:45.424824 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-f0b90b46-f77e-447e-b82a-b57b19bbac96 req-5eccd111-c197-48fc-a4f3-12d9025cac1d service nova] Creating event network-changed:bf1963f9-4d7c-4562-9c53-6c53a728e8c6 for instance 7d0cbdc8-d87b-4ce4-97d1-59aca342287a on hv-cinder-84327 Jun 15 14:48:45.429790 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-f0b90b46-f77e-447e-b82a-b57b19bbac96 req-5eccd111-c197-48fc-a4f3-12d9025cac1d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030424 Jun 15 14:48:45.430390 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 341/705] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:48:45.865500 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c8627b2d-7aee-4041-b3fb-e6624364861c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:45.866155 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c8627b2d-7aee-4041-b3fb-e6624364861c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:45.872854 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c8627b2d-7aee-4041-b3fb-e6624364861c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:45.873312 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c8627b2d-7aee-4041-b3fb-e6624364861c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:45.874178 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c8627b2d-7aee-4041-b3fb-e6624364861c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:45.874659 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c8627b2d-7aee-4041-b3fb-e6624364861c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:46.006598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c8627b2d-7aee-4041-b3fb-e6624364861c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:46.011768 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-0146cdbc-b115-47c1-983b-0700251ce40f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:46.012471 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-0146cdbc-b115-47c1-983b-0700251ce40f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:46.015055 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-c8627b2d-7aee-4041-b3fb-e6624364861c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1734 microversion: 2.1 time: 0.153378 Jun 15 14:48:46.015715 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 365/706] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:45 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:46.018814 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0146cdbc-b115-47c1-983b-0700251ce40f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:46.019290 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0146cdbc-b115-47c1-983b-0700251ce40f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:46.020054 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0146cdbc-b115-47c1-983b-0700251ce40f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:46.020488 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0146cdbc-b115-47c1-983b-0700251ce40f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:46.162168 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-0146cdbc-b115-47c1-983b-0700251ce40f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:46.170580 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-0146cdbc-b115-47c1-983b-0700251ce40f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:46.172085 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-0146cdbc-b115-47c1-983b-0700251ce40f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:46.173195 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-0146cdbc-b115-47c1-983b-0700251ce40f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1404 microversion: 2.20 time: 0.166319 Jun 15 14:48:46.173773 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 342/707] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:48:46 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1404 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:48:47.031991 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-54e3b98f-7650-4117-b2f2-7339fd588930 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:47.032580 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-54e3b98f-7650-4117-b2f2-7339fd588930 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:47.038968 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-54e3b98f-7650-4117-b2f2-7339fd588930 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:47.039415 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-54e3b98f-7650-4117-b2f2-7339fd588930 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:47.040166 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-54e3b98f-7650-4117-b2f2-7339fd588930 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:47.041218 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-54e3b98f-7650-4117-b2f2-7339fd588930 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:47.191099 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-83a35dcd-f0e5-45d4-b3e6-97ae3da0ab1b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:47.192343 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-83a35dcd-f0e5-45d4-b3e6-97ae3da0ab1b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:47.194787 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:47.200846 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-83a35dcd-f0e5-45d4-b3e6-97ae3da0ab1b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:47.201284 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-83a35dcd-f0e5-45d4-b3e6-97ae3da0ab1b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:47.202073 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-83a35dcd-f0e5-45d4-b3e6-97ae3da0ab1b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:47.202506 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-83a35dcd-f0e5-45d4-b3e6-97ae3da0ab1b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:47.206070 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-54e3b98f-7650-4117-b2f2-7339fd588930 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:47.214124 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-54e3b98f-7650-4117-b2f2-7339fd588930 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1734 microversion: 2.1 time: 0.185876 Jun 15 14:48:47.214704 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 366/708] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:47 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1734 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:47.335122 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-83a35dcd-f0e5-45d4-b3e6-97ae3da0ab1b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:47.343757 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-83a35dcd-f0e5-45d4-b3e6-97ae3da0ab1b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:47.345246 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-83a35dcd-f0e5-45d4-b3e6-97ae3da0ab1b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:47.346624 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-83a35dcd-f0e5-45d4-b3e6-97ae3da0ab1b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1404 microversion: 2.20 time: 0.159388 Jun 15 14:48:47.347174 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 343/709] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:48:47 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:48:48.231026 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-1a959cd1-56a3-4083-87d3-86a3d1b43ce7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:48.231543 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-1a959cd1-56a3-4083-87d3-86a3d1b43ce7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:48.238120 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1a959cd1-56a3-4083-87d3-86a3d1b43ce7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:48.238563 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1a959cd1-56a3-4083-87d3-86a3d1b43ce7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:48.239334 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1a959cd1-56a3-4083-87d3-86a3d1b43ce7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:48.239777 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1a959cd1-56a3-4083-87d3-86a3d1b43ce7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:48.365995 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-d37101dc-675b-4493-a4e6-9a61bd5632fd tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:48.366604 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-d37101dc-675b-4493-a4e6-9a61bd5632fd tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:48.374230 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d37101dc-675b-4493-a4e6-9a61bd5632fd tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:48.374757 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d37101dc-675b-4493-a4e6-9a61bd5632fd tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:48.375286 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-1a959cd1-56a3-4083-87d3-86a3d1b43ce7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:48.375687 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d37101dc-675b-4493-a4e6-9a61bd5632fd tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:48.376193 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d37101dc-675b-4493-a4e6-9a61bd5632fd tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:48.383530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-1a959cd1-56a3-4083-87d3-86a3d1b43ce7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1734 microversion: 2.1 time: 0.156492 Jun 15 14:48:48.384108 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 367/710] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:48 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:48.511155 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-d37101dc-675b-4493-a4e6-9a61bd5632fd tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:48.519051 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-d37101dc-675b-4493-a4e6-9a61bd5632fd tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:48.520537 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-d37101dc-675b-4493-a4e6-9a61bd5632fd tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:48.521642 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-d37101dc-675b-4493-a4e6-9a61bd5632fd tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1404 microversion: 2.20 time: 0.160498 Jun 15 14:48:48.522228 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 344/711] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:48:48 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:48:49.402430 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-bf0e30d0-8687-4419-8267-da99b00eb690 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:49.403046 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-bf0e30d0-8687-4419-8267-da99b00eb690 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:49.410133 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bf0e30d0-8687-4419-8267-da99b00eb690 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:49.410950 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bf0e30d0-8687-4419-8267-da99b00eb690 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:49.412330 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bf0e30d0-8687-4419-8267-da99b00eb690 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:49.413105 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bf0e30d0-8687-4419-8267-da99b00eb690 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:49.539443 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-79c08a59-5ba1-4928-9e47-1c2ffe6b54cd tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:49.540199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-79c08a59-5ba1-4928-9e47-1c2ffe6b54cd tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:49.546724 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-79c08a59-5ba1-4928-9e47-1c2ffe6b54cd tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:49.547179 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-79c08a59-5ba1-4928-9e47-1c2ffe6b54cd tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:49.547899 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-bf0e30d0-8687-4419-8267-da99b00eb690 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:49.548027 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-79c08a59-5ba1-4928-9e47-1c2ffe6b54cd tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:49.548382 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-79c08a59-5ba1-4928-9e47-1c2ffe6b54cd tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:49.555909 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-bf0e30d0-8687-4419-8267-da99b00eb690 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1714 microversion: 2.1 time: 0.158354 Jun 15 14:48:49.556484 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 368/712] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:49 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1714 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:49.663753 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0e554869-6ddf-4437-91a9-b96399d0ba2d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:49.664471 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-0e554869-6ddf-4437-91a9-b96399d0ba2d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:49.670573 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0e554869-6ddf-4437-91a9-b96399d0ba2d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:49.671030 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0e554869-6ddf-4437-91a9-b96399d0ba2d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:49.671799 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0e554869-6ddf-4437-91a9-b96399d0ba2d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:49.672236 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0e554869-6ddf-4437-91a9-b96399d0ba2d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:49.683822 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-79c08a59-5ba1-4928-9e47-1c2ffe6b54cd tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:49.691894 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-79c08a59-5ba1-4928-9e47-1c2ffe6b54cd tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:49.693395 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-79c08a59-5ba1-4928-9e47-1c2ffe6b54cd tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:49.694523 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-79c08a59-5ba1-4928-9e47-1c2ffe6b54cd tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1404 microversion: 2.20 time: 0.158959 Jun 15 14:48:49.695077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 345/713] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:48:49 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:48:49.752228 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-0e554869-6ddf-4437-91a9-b96399d0ba2d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] HTTP exception thrown: Cannot 'detach_volume' instance c7677949-b0c4-4f8a-bf16-26a4c639c344 while it is in vm_state rescued Jun 15 14:48:49.753677 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0e554869-6ddf-4437-91a9-b96399d0ba2d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Request method failure captured: Jun 15 14:48:49.753677 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: DELETE /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344/os-volume_attachments/5fddacf2-4e45-4710-aca6-4157a311e44f HTTP/1.1 Jun 15 14:48:49.753677 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:48:49.753677 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:48:49.753677 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:48:49.753677 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:48:49.753677 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:48:49.753677 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:48:49.753677 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:48:49.753677 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:48:49.753677 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfAJ8wPnkqs_k4Bo8GSWGVuB1Ap-R1u4L7mH2U3HEuvWVNvlRBO_qyAD7QzOZMMEzF_zcaK0X4c1eXso_54pW74XDCCkghDRm0zR7H0M-gVJaO4FWuw9AQkWNKuoAF0zQpil6wRuiB3fOyyvDJwL5UyfZxFCESuQo14vuw2L05AA968 Jun 15 14:48:49.753677 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:48:49.753677 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:48:49.753677 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:48:49.753677 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:48:49.753677 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:48:49.753677 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:48:49.753677 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 26d36b3b04f046d3bee421c5987b965b Jun 15 14:48:49.753677 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1197112882 Jun 15 14:48:49.753677 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:48:49.753677 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:48:49.755147 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/26d36b3b04f046d3bee421c5987b965b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_26d36b3b04f046d3bee421c5987b965b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/26d36b3b04f046d3bee421c5987b965b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/26d36b3b04f046d3bee421c5987b965b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:48:49.755147 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1197112882 Jun 15 14:48:49.755147 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 26d36b3b04f046d3bee421c5987b965b Jun 15 14:48:49.755147 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1197112882 Jun 15 14:48:49.755147 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-ServerRescueNegativeTestJSON-1197112882-project Jun 15 14:48:49.755147 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:48:49.755147 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:48:49.755147 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: ed7372fed3e14f3e98ca25d22a7c7a7e Jun 15 14:48:49.755147 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1197112882-project Jun 15 14:48:49.755147 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:48:49.755147 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Cannot 'detach_volume' instance c7677949-b0c4-4f8a-bf16-26a4c639c344 while it is in vm_state rescued Jun 15 14:48:49.755965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'server_id': 'c7677949-b0c4-4f8a-bf16-26a4c639c344', 'id': '5fddacf2-4e45-4710-aca6-4157a311e44f'} Jun 15 14:48:49.755965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:48:49.755965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:48:49.755965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 14:48:49.755965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 14:48:49.755965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 14:48:49.755965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 14:48:49.755965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 15 14:48:49.755965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 15 14:48:49.755965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c7677949-b0c4-4f8a-bf16-26a4c639c344 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 15 14:48:49.755965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:48:49.755965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:48:49.755965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:48:49.755965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:48:49.755965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:48:49.755965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:48:49.755965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:48:49.755965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:48:49.755965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:48:49.755965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:48:49.757209 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 15 14:48:49.757209 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 15 14:48:49.757209 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 15 14:48:49.757209 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 15 14:48:49.757209 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c7677949-b0c4-4f8a-bf16-26a4c639c344 while it is in vm_state rescued Jun 15 14:48:49.757209 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:48:49.757209 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:48:49.757209 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:48:49.757209 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:48:49.757209 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:48:49.757209 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:48:49.757209 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:48:49.757209 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:48:49.757209 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c7677949-b0c4-4f8a-bf16-26a4c639c344 while it is in vm_state rescued Jun 15 14:48:49.757209 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:48:49.757209 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0e554869-6ddf-4437-91a9-b96399d0ba2d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Returning 409 to user: Cannot 'detach_volume' instance c7677949-b0c4-4f8a-bf16-26a4c639c344 while it is in vm_state rescued {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:48:49.758175 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-0e554869-6ddf-4437-91a9-b96399d0ba2d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344/os-volume_attachments/5fddacf2-4e45-4710-aca6-4157a311e44f" status: 409 len: 152 microversion: 2.1 time: 0.095337 Jun 15 14:48:49.758175 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 369/714] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Jun 15 14:48:49 2022] DELETE /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344/os-volume_attachments/5fddacf2-4e45-4710-aca6-4157a311e44f => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 15 14:48:49.764569 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-b940885d-dcfb-4a4c-b40e-39c3df3ffc0c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:49.765105 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-b940885d-dcfb-4a4c-b40e-39c3df3ffc0c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:49.771549 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b940885d-dcfb-4a4c-b40e-39c3df3ffc0c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:49.772006 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b940885d-dcfb-4a4c-b40e-39c3df3ffc0c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:49.772792 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b940885d-dcfb-4a4c-b40e-39c3df3ffc0c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:49.773234 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b940885d-dcfb-4a4c-b40e-39c3df3ffc0c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:49.839522 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-b940885d-dcfb-4a4c-b40e-39c3df3ffc0c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "POST /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344/action" status: 202 len: 0 microversion: 2.1 time: 0.078605 Jun 15 14:48:49.843130 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 346/715] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 14:48:49 2022] POST /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 14:48:49.848389 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3d648d6c-3235-4d27-ad93-6821c04032b8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:49.849006 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-3d648d6c-3235-4d27-ad93-6821c04032b8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:49.855060 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3d648d6c-3235-4d27-ad93-6821c04032b8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:49.855508 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3d648d6c-3235-4d27-ad93-6821c04032b8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:49.856273 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3d648d6c-3235-4d27-ad93-6821c04032b8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:49.856720 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3d648d6c-3235-4d27-ad93-6821c04032b8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:49.983238 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-3d648d6c-3235-4d27-ad93-6821c04032b8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:49.991033 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-3d648d6c-3235-4d27-ad93-6821c04032b8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1722 microversion: 2.1 time: 0.146710 Jun 15 14:48:49.991578 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 370/716] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:49 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:50.713505 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-b3265ae1-3529-44c4-9698-35ee9d126491 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:50.714241 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-b3265ae1-3529-44c4-9698-35ee9d126491 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:50.722146 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b3265ae1-3529-44c4-9698-35ee9d126491 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:50.722596 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b3265ae1-3529-44c4-9698-35ee9d126491 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:50.723369 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b3265ae1-3529-44c4-9698-35ee9d126491 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:50.723809 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b3265ae1-3529-44c4-9698-35ee9d126491 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:50.857039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-b3265ae1-3529-44c4-9698-35ee9d126491 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:50.860547 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:50.865716 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-b3265ae1-3529-44c4-9698-35ee9d126491 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:50.867211 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-b3265ae1-3529-44c4-9698-35ee9d126491 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:50.868313 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-b3265ae1-3529-44c4-9698-35ee9d126491 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1404 microversion: 2.20 time: 0.159766 Jun 15 14:48:50.868911 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 347/717] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:48:50 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:48:51.009098 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0a75b2e1-3251-4a67-9bd2-6fdf7c73d66f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:51.010462 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-0a75b2e1-3251-4a67-9bd2-6fdf7c73d66f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:51.016733 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0a75b2e1-3251-4a67-9bd2-6fdf7c73d66f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:51.017180 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0a75b2e1-3251-4a67-9bd2-6fdf7c73d66f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:51.017979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0a75b2e1-3251-4a67-9bd2-6fdf7c73d66f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:51.018418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0a75b2e1-3251-4a67-9bd2-6fdf7c73d66f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:51.020916 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:51.152639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0a75b2e1-3251-4a67-9bd2-6fdf7c73d66f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:51.160619 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-0a75b2e1-3251-4a67-9bd2-6fdf7c73d66f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1722 microversion: 2.1 time: 0.155413 Jun 15 14:48:51.161180 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 371/718] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:51 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:51.887885 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-9cf8c69a-6336-4dec-a415-830de80e0efe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:51.888587 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-9cf8c69a-6336-4dec-a415-830de80e0efe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:51.896307 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9cf8c69a-6336-4dec-a415-830de80e0efe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:51.896763 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9cf8c69a-6336-4dec-a415-830de80e0efe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:51.897544 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9cf8c69a-6336-4dec-a415-830de80e0efe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:51.898060 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9cf8c69a-6336-4dec-a415-830de80e0efe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:52.037030 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9cf8c69a-6336-4dec-a415-830de80e0efe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:52.045936 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9cf8c69a-6336-4dec-a415-830de80e0efe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:52.047366 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9cf8c69a-6336-4dec-a415-830de80e0efe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:52.048478 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-9cf8c69a-6336-4dec-a415-830de80e0efe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1404 microversion: 2.20 time: 0.165139 Jun 15 14:48:52.049026 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 348/719] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:48:51 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1404 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:48:52.177301 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-bfe9fb81-6653-4536-a907-592d482a10d2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:52.177935 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-bfe9fb81-6653-4536-a907-592d482a10d2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:52.185071 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bfe9fb81-6653-4536-a907-592d482a10d2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:52.185527 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bfe9fb81-6653-4536-a907-592d482a10d2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:52.186322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bfe9fb81-6653-4536-a907-592d482a10d2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:52.186761 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bfe9fb81-6653-4536-a907-592d482a10d2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:52.315575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-bfe9fb81-6653-4536-a907-592d482a10d2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:52.326248 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-bfe9fb81-6653-4536-a907-592d482a10d2 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1722 microversion: 2.1 time: 0.152743 Jun 15 14:48:52.326817 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 372/720] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:52 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:53.066233 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-f7f5ecdd-299e-4627-bd99-4b2096d5f20d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:53.066848 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-f7f5ecdd-299e-4627-bd99-4b2096d5f20d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:53.068676 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=2 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:53.069340 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=10 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:53.075675 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f7f5ecdd-299e-4627-bd99-4b2096d5f20d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:53.076125 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f7f5ecdd-299e-4627-bd99-4b2096d5f20d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:53.076925 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f7f5ecdd-299e-4627-bd99-4b2096d5f20d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:53.077394 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f7f5ecdd-299e-4627-bd99-4b2096d5f20d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:53.211168 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-f7f5ecdd-299e-4627-bd99-4b2096d5f20d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:53.220082 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-f7f5ecdd-299e-4627-bd99-4b2096d5f20d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:53.221874 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-f7f5ecdd-299e-4627-bd99-4b2096d5f20d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:53.222980 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-f7f5ecdd-299e-4627-bd99-4b2096d5f20d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1404 microversion: 2.20 time: 0.160692 Jun 15 14:48:53.223537 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 349/721] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:48:53 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:48:53.344071 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3fe2cb96-ebcb-4290-b39e-8de77f46ce1c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:53.344687 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-3fe2cb96-ebcb-4290-b39e-8de77f46ce1c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:53.346829 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=2 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:53.352608 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3fe2cb96-ebcb-4290-b39e-8de77f46ce1c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:53.353062 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3fe2cb96-ebcb-4290-b39e-8de77f46ce1c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:53.353956 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3fe2cb96-ebcb-4290-b39e-8de77f46ce1c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:53.354403 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3fe2cb96-ebcb-4290-b39e-8de77f46ce1c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:53.486479 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-3fe2cb96-ebcb-4290-b39e-8de77f46ce1c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:53.495096 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-3fe2cb96-ebcb-4290-b39e-8de77f46ce1c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1728 microversion: 2.1 time: 0.154945 Jun 15 14:48:53.495660 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 373/722] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:48:53 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:53.513375 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-df0a12e0-69ff-4e94-a7f7-258a1a61ed19 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:53.513908 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-df0a12e0-69ff-4e94-a7f7-258a1a61ed19 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:53.519921 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-df0a12e0-69ff-4e94-a7f7-258a1a61ed19 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:53.520370 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-df0a12e0-69ff-4e94-a7f7-258a1a61ed19 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:53.521129 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-df0a12e0-69ff-4e94-a7f7-258a1a61ed19 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:53.521567 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-df0a12e0-69ff-4e94-a7f7-258a1a61ed19 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:53.596361 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-df0a12e0-69ff-4e94-a7f7-258a1a61ed19 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088669 Jun 15 14:48:53.596949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 350/723] 10.222.0.57 () {58 vars in 1274 bytes} [Wed Jun 15 14:48:53 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:54.103466 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-709fedb2-3da9-4c03-9347-edde0dd8c655 req-0f1f876f-e32c-4f31-8cd0-4ff93c2b7e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d0cbdc8-d87b-4ce4-97d1-59aca342287a", "name": "network-vif-plugged", "status": "completed", "tag": "bf1963f9-4d7c-4562-9c53-6c53a728e8c6"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:54.120044 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-709fedb2-3da9-4c03-9347-edde0dd8c655 req-0f1f876f-e32c-4f31-8cd0-4ff93c2b7e6a service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:54.120488 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-709fedb2-3da9-4c03-9347-edde0dd8c655 req-0f1f876f-e32c-4f31-8cd0-4ff93c2b7e6a service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:54.136403 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-709fedb2-3da9-4c03-9347-edde0dd8c655 req-0f1f876f-e32c-4f31-8cd0-4ff93c2b7e6a service nova] Creating event network-vif-plugged:bf1963f9-4d7c-4562-9c53-6c53a728e8c6 for instance 7d0cbdc8-d87b-4ce4-97d1-59aca342287a on hv-cinder-84327 Jun 15 14:48:54.141322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-709fedb2-3da9-4c03-9347-edde0dd8c655 req-0f1f876f-e32c-4f31-8cd0-4ff93c2b7e6a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102347 Jun 15 14:48:54.142318 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 374/724] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:54.241489 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-b61a6a4c-245a-414a-b4da-dc2a3cf8bf3d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:54.242291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-b61a6a4c-245a-414a-b4da-dc2a3cf8bf3d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:54.249169 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b61a6a4c-245a-414a-b4da-dc2a3cf8bf3d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:54.249729 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b61a6a4c-245a-414a-b4da-dc2a3cf8bf3d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:54.250576 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b61a6a4c-245a-414a-b4da-dc2a3cf8bf3d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:54.251086 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b61a6a4c-245a-414a-b4da-dc2a3cf8bf3d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:54.470931 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-b61a6a4c-245a-414a-b4da-dc2a3cf8bf3d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:54.484871 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-b61a6a4c-245a-414a-b4da-dc2a3cf8bf3d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:54.486416 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-b61a6a4c-245a-414a-b4da-dc2a3cf8bf3d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:54.487550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-b61a6a4c-245a-414a-b4da-dc2a3cf8bf3d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1404 microversion: 2.20 time: 0.250558 Jun 15 14:48:54.488119 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 351/725] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:48:54 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1404 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:48:54.618708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-43810294-34e1-4dd7-bf8c-b536ae53eb17 req-bbd7c5b1-5130-4b3e-a5b6-131ad415ba78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7677949-b0c4-4f8a-bf16-26a4c639c344", "tag": "faff7f9d-2ca1-439d-8ffd-5a9dad77ee86"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:54.626960 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-43810294-34e1-4dd7-bf8c-b536ae53eb17 req-bbd7c5b1-5130-4b3e-a5b6-131ad415ba78 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:54.627487 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-43810294-34e1-4dd7-bf8c-b536ae53eb17 req-bbd7c5b1-5130-4b3e-a5b6-131ad415ba78 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:54.638852 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-43810294-34e1-4dd7-bf8c-b536ae53eb17 req-bbd7c5b1-5130-4b3e-a5b6-131ad415ba78 service nova] Creating event network-changed:faff7f9d-2ca1-439d-8ffd-5a9dad77ee86 for instance c7677949-b0c4-4f8a-bf16-26a4c639c344 on hv-cinder-84327 Jun 15 14:48:54.643819 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-43810294-34e1-4dd7-bf8c-b536ae53eb17 req-bbd7c5b1-5130-4b3e-a5b6-131ad415ba78 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094862 Jun 15 14:48:54.644497 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 375/726] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:55.505528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a979491f-b10f-492d-9f29-5876935f9250 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:55.506182 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a979491f-b10f-492d-9f29-5876935f9250 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:55.512823 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a979491f-b10f-492d-9f29-5876935f9250 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:55.513272 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a979491f-b10f-492d-9f29-5876935f9250 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:55.514069 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a979491f-b10f-492d-9f29-5876935f9250 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:55.514505 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a979491f-b10f-492d-9f29-5876935f9250 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:55.643060 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a979491f-b10f-492d-9f29-5876935f9250 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:55.651394 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a979491f-b10f-492d-9f29-5876935f9250 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:55.652872 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a979491f-b10f-492d-9f29-5876935f9250 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:55.653993 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a979491f-b10f-492d-9f29-5876935f9250 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1404 microversion: 2.20 time: 0.152338 Jun 15 14:48:55.654549 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 352/727] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:48:55 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:48:56.659581 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-8981d81c-7295-4d2f-af34-8ccf6cd54165 req-125fd52b-515f-4f58-a1e3-7c0d3ad26d40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7677949-b0c4-4f8a-bf16-26a4c639c344", "tag": "faff7f9d-2ca1-439d-8ffd-5a9dad77ee86"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:56.667921 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-8981d81c-7295-4d2f-af34-8ccf6cd54165 req-125fd52b-515f-4f58-a1e3-7c0d3ad26d40 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:56.668369 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-8981d81c-7295-4d2f-af34-8ccf6cd54165 req-125fd52b-515f-4f58-a1e3-7c0d3ad26d40 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:56.673981 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-f32f1b67-d15d-4eb2-a23a-25a7f315a576 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:56.674599 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-f32f1b67-d15d-4eb2-a23a-25a7f315a576 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:56.679165 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-8981d81c-7295-4d2f-af34-8ccf6cd54165 req-125fd52b-515f-4f58-a1e3-7c0d3ad26d40 service nova] Creating event network-changed:faff7f9d-2ca1-439d-8ffd-5a9dad77ee86 for instance c7677949-b0c4-4f8a-bf16-26a4c639c344 on hv-cinder-84327 Jun 15 14:48:56.681047 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f32f1b67-d15d-4eb2-a23a-25a7f315a576 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:56.682203 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f32f1b67-d15d-4eb2-a23a-25a7f315a576 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:56.682986 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f32f1b67-d15d-4eb2-a23a-25a7f315a576 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:56.683492 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f32f1b67-d15d-4eb2-a23a-25a7f315a576 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:56.684640 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-8981d81c-7295-4d2f-af34-8ccf6cd54165 req-125fd52b-515f-4f58-a1e3-7c0d3ad26d40 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029530 Jun 15 14:48:56.685219 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 376/728] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:56.815173 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-f32f1b67-d15d-4eb2-a23a-25a7f315a576 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:56.823427 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-f32f1b67-d15d-4eb2-a23a-25a7f315a576 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:56.824996 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-f32f1b67-d15d-4eb2-a23a-25a7f315a576 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:48:56.826249 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-f32f1b67-d15d-4eb2-a23a-25a7f315a576 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1596 microversion: 2.20 time: 0.156112 Jun 15 14:48:56.826804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 353/729] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:48:56 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1596 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:48:56.844136 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-767f8bdc-70a5-430d-b479-844559cfde78 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:56.844709 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-767f8bdc-70a5-430d-b479-844559cfde78 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:48:56.851100 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-767f8bdc-70a5-430d-b479-844559cfde78 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:56.851593 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-767f8bdc-70a5-430d-b479-844559cfde78 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:56.852543 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-767f8bdc-70a5-430d-b479-844559cfde78 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:56.852977 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-767f8bdc-70a5-430d-b479-844559cfde78 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:56.932586 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-767f8bdc-70a5-430d-b479-844559cfde78 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091592 Jun 15 14:48:56.933188 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 377/730] 10.222.0.57 () {60 vars in 1315 bytes} [Wed Jun 15 14:48:56 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:48:58.346075 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-4ed71522-0b1d-4f26-8d81-b8a40e43ef95 req-4b92f4f8-67fb-4b74-81ea-9ff7d56fe170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d0cbdc8-d87b-4ce4-97d1-59aca342287a", "tag": "bf1963f9-4d7c-4562-9c53-6c53a728e8c6"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:58.355369 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-4ed71522-0b1d-4f26-8d81-b8a40e43ef95 req-4b92f4f8-67fb-4b74-81ea-9ff7d56fe170 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:58.355822 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-4ed71522-0b1d-4f26-8d81-b8a40e43ef95 req-4b92f4f8-67fb-4b74-81ea-9ff7d56fe170 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:58.379950 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-4ed71522-0b1d-4f26-8d81-b8a40e43ef95 req-4b92f4f8-67fb-4b74-81ea-9ff7d56fe170 service nova] Creating event network-changed:bf1963f9-4d7c-4562-9c53-6c53a728e8c6 for instance 7d0cbdc8-d87b-4ce4-97d1-59aca342287a on hv-cinder-84327 Jun 15 14:48:58.385683 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-4ed71522-0b1d-4f26-8d81-b8a40e43ef95 req-4b92f4f8-67fb-4b74-81ea-9ff7d56fe170 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043566 Jun 15 14:48:58.386279 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 354/731] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:49:08.054452 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=35 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:08.055208 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=27 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:08.060134 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-a9f767a1-aa77-498d-8a61-b777577736b4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:08.061093 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-a9f767a1-aa77-498d-8a61-b777577736b4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:08.067969 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a9f767a1-aa77-498d-8a61-b777577736b4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:08.068418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a9f767a1-aa77-498d-8a61-b777577736b4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:08.069182 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a9f767a1-aa77-498d-8a61-b777577736b4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:08.069617 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a9f767a1-aa77-498d-8a61-b777577736b4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:08.097698 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-a9f767a1-aa77-498d-8a61-b777577736b4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044868 Jun 15 14:49:08.098237 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 378/732] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 14:49:08 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 14:49:08.154907 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-37426c0c-6da0-41e1-963e-e92eeb5c0f83 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:08.155478 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-37426c0c-6da0-41e1-963e-e92eeb5c0f83 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:08.162312 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-37426c0c-6da0-41e1-963e-e92eeb5c0f83 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:08.162756 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-37426c0c-6da0-41e1-963e-e92eeb5c0f83 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:08.163506 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-37426c0c-6da0-41e1-963e-e92eeb5c0f83 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:08.163937 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-37426c0c-6da0-41e1-963e-e92eeb5c0f83 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:08.189180 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-37426c0c-6da0-41e1-963e-e92eeb5c0f83 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Going to try to terminate instance {{(pid=124220) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:49:08.264145 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-37426c0c-6da0-41e1-963e-e92eeb5c0f83 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "DELETE /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 204 len: 0 microversion: 2.1 time: 0.112906 Jun 15 14:49:08.264775 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 355/733] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:49:08 2022] DELETE /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:49:08.273141 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-8518df4e-8224-449a-8429-f5b3ba042993 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:08.273775 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-8518df4e-8224-449a-8429-f5b3ba042993 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:08.280119 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8518df4e-8224-449a-8429-f5b3ba042993 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:08.280572 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8518df4e-8224-449a-8429-f5b3ba042993 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:08.281335 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8518df4e-8224-449a-8429-f5b3ba042993 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:08.281823 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8518df4e-8224-449a-8429-f5b3ba042993 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:08.419704 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-8518df4e-8224-449a-8429-f5b3ba042993 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:08.427279 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-8518df4e-8224-449a-8429-f5b3ba042993 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1675 microversion: 2.1 time: 0.158004 Jun 15 14:49:08.427840 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 379/734] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:08 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:09.445045 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-5538185d-1838-43f5-90f3-bcbdb3a33878 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:09.445811 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-5538185d-1838-43f5-90f3-bcbdb3a33878 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:09.452984 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5538185d-1838-43f5-90f3-bcbdb3a33878 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:09.453438 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5538185d-1838-43f5-90f3-bcbdb3a33878 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:09.454243 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5538185d-1838-43f5-90f3-bcbdb3a33878 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:09.455006 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5538185d-1838-43f5-90f3-bcbdb3a33878 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:09.589258 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-5538185d-1838-43f5-90f3-bcbdb3a33878 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:09.597307 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-5538185d-1838-43f5-90f3-bcbdb3a33878 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1675 microversion: 2.1 time: 0.156481 Jun 15 14:49:09.597906 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 356/735] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:09 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:10.614892 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-386eb119-ce65-40ca-b35e-f9e14787ed0e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:10.615498 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-386eb119-ce65-40ca-b35e-f9e14787ed0e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:10.622767 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-386eb119-ce65-40ca-b35e-f9e14787ed0e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:10.623211 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-386eb119-ce65-40ca-b35e-f9e14787ed0e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:10.623977 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-386eb119-ce65-40ca-b35e-f9e14787ed0e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:10.624410 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-386eb119-ce65-40ca-b35e-f9e14787ed0e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:10.693622 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-386eb119-ce65-40ca-b35e-f9e14787ed0e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:10.701779 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-386eb119-ce65-40ca-b35e-f9e14787ed0e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1608 microversion: 2.1 time: 0.090724 Jun 15 14:49:10.702351 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 380/736] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:10 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1608 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:11.136044 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-0f8a1e65-1b09-4c85-94b3-a29bfa48ec14 req-5ec9b62d-5ef3-4394-9abd-ab9ece97e83e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "401c9feb-30ca-4df6-9fba-0a05da5dce7b", "name": "network-vif-deleted", "tag": "fb5c9876-5726-466e-a543-a3f84f0df112"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:11.145207 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-0f8a1e65-1b09-4c85-94b3-a29bfa48ec14 req-5ec9b62d-5ef3-4394-9abd-ab9ece97e83e service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:11.145690 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-0f8a1e65-1b09-4c85-94b3-a29bfa48ec14 req-5ec9b62d-5ef3-4394-9abd-ab9ece97e83e service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:11.157294 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-0f8a1e65-1b09-4c85-94b3-a29bfa48ec14 req-5ec9b62d-5ef3-4394-9abd-ab9ece97e83e service nova] Creating event network-vif-deleted:fb5c9876-5726-466e-a543-a3f84f0df112 for instance 401c9feb-30ca-4df6-9fba-0a05da5dce7b on hv-cinder-84327 Jun 15 14:49:11.162206 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-0f8a1e65-1b09-4c85-94b3-a29bfa48ec14 req-5ec9b62d-5ef3-4394-9abd-ab9ece97e83e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029998 Jun 15 14:49:11.162818 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 357/737] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:11.719274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-faa13318-5f54-4752-b3c1-178b6fe20eda tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:11.720007 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-faa13318-5f54-4752-b3c1-178b6fe20eda tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:11.727001 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-faa13318-5f54-4752-b3c1-178b6fe20eda tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:11.727591 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-faa13318-5f54-4752-b3c1-178b6fe20eda tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:11.729229 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-faa13318-5f54-4752-b3c1-178b6fe20eda tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:11.729739 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-faa13318-5f54-4752-b3c1-178b6fe20eda tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:11.762299 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-faa13318-5f54-4752-b3c1-178b6fe20eda tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:11.762751 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-faa13318-5f54-4752-b3c1-178b6fe20eda tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:11.763197 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.objects.instance [None req-faa13318-5f54-4752-b3c1-178b6fe20eda tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lazy-loading 'fault' on Instance uuid 401c9feb-30ca-4df6-9fba-0a05da5dce7b {{(pid=124219) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:49:11.806827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-faa13318-5f54-4752-b3c1-178b6fe20eda tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:11.814319 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-faa13318-5f54-4752-b3c1-178b6fe20eda tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 200 len: 1328 microversion: 2.1 time: 0.098890 Jun 15 14:49:11.815078 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 381/738] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:11 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 1328 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:12.832324 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-827302a5-552d-4dce-8751-7b10acdaa714 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:12.833031 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-827302a5-552d-4dce-8751-7b10acdaa714 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:12.839893 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-827302a5-552d-4dce-8751-7b10acdaa714 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:12.840350 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-827302a5-552d-4dce-8751-7b10acdaa714 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:12.841146 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-827302a5-552d-4dce-8751-7b10acdaa714 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:12.841594 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-827302a5-552d-4dce-8751-7b10acdaa714 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:12.855635 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.wsgi [None req-827302a5-552d-4dce-8751-7b10acdaa714 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] HTTP exception thrown: Instance 401c9feb-30ca-4df6-9fba-0a05da5dce7b could not be found. Jun 15 14:49:12.857239 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-827302a5-552d-4dce-8751-7b10acdaa714 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Request method failure captured: Jun 15 14:49:12.857239 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: request: GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b HTTP/1.1 Jun 15 14:49:12.857239 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept: application/json Jun 15 14:49:12.857239 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept-Encoding: identity Jun 15 14:49:12.857239 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Connection: close Jun 15 14:49:12.857239 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Length: 0 Jun 15 14:49:12.857239 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Type: application/json Jun 15 14:49:12.857239 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Host: 10.222.0.57 Jun 15 14:49:12.857239 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Openstack-System-Scope: None Jun 15 14:49:12.857239 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: User-Agent: python-urllib3/1.26.9 Jun 15 14:49:12.857239 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Auth-Token: gAAAAABiqfAJbOMAn4uuMkObo-mKlEXE2sBkt8BVXSXuSs2-tUHPjy235pz3ZfhHF4IXCVW6sAR2sfQIWe12-EdW2FzfFNe8sHSOX5z1Z169ZX9Np5yjTEqN-R545Wm35ZLsEh7ox97tPIOOrfTYdJHHGByAhvQkLnH24ukI9ee6odfAZSUkUuw Jun 15 14:49:12.857239 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Id: None Jun 15 14:49:12.857239 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Name: None Jun 15 14:49:12.857239 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Identity-Status: Confirmed Jun 15 14:49:12.857239 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Is-Admin-Project: True Jun 15 14:49:12.857239 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Id: default Jun 15 14:49:12.857239 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Name: Default Jun 15 14:49:12.857239 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Id: 0c12c8e1398843eca8746543a0684841 Jun 15 14:49:12.857239 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Name: tempest-AttachVolumeTestJSON-2133096874 Jun 15 14:49:12.857239 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Role: member,reader Jun 15 14:49:12.857239 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Roles: member,reader Jun 15 14:49:12.858905 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0c12c8e1398843eca8746543a0684841"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0c12c8e1398843eca8746543a0684841", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0c12c8e1398843eca8746543a0684841"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0c12c8e1398843eca8746543a0684841"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:49:12.858905 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant: tempest-AttachVolumeTestJSON-2133096874 Jun 15 14:49:12.858905 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Id: 0c12c8e1398843eca8746543a0684841 Jun 15 14:49:12.858905 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2133096874 Jun 15 14:49:12.858905 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User: tempest-AttachVolumeTestJSON-2133096874-project Jun 15 14:49:12.858905 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Id: default Jun 15 14:49:12.858905 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Name: Default Jun 15 14:49:12.858905 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Id: 28ff37865a9b49ec8601140fca00a627 Jun 15 14:49:12.858905 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Name: tempest-AttachVolumeTestJSON-2133096874-project Jun 15 14:49:12.858905 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: method: > Jun 15 14:49:12.858905 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: exception: Instance 401c9feb-30ca-4df6-9fba-0a05da5dce7b could not be found. Jun 15 14:49:12.858905 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: action_args: {'id': '401c9feb-30ca-4df6-9fba-0a05da5dce7b'} Jun 15 14:49:12.859701 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:49:12.859701 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:12.859701 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:49:12.859701 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:49:12.859701 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:49:12.859701 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:49:12.859701 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:49:12.859701 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:49:12.859701 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:49:12.859701 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:49:12.859701 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 401c9feb-30ca-4df6-9fba-0a05da5dce7b could not be found. Jun 15 14:49:12.859701 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:49:12.859701 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:12.859701 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:49:12.859701 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:12.859701 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:12.859701 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:12.859701 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:49:12.859701 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:49:12.859701 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:49:12.860949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:49:12.860949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:49:12.860949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:49:12.860949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:49:12.860949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:49:12.860949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:49:12.860949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:49:12.860949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 401c9feb-30ca-4df6-9fba-0a05da5dce7b could not be found. Jun 15 14:49:12.860949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:49:12.860949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:12.860949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:49:12.860949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:12.860949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:12.860949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:12.860949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:49:12.860949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:49:12.860949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 401c9feb-30ca-4df6-9fba-0a05da5dce7b could not be found. Jun 15 14:49:12.860949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:49:12.862063 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-827302a5-552d-4dce-8751-7b10acdaa714 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Returning 404 to user: Instance 401c9feb-30ca-4df6-9fba-0a05da5dce7b could not be found. {{(pid=124220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:49:12.862063 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-827302a5-552d-4dce-8751-7b10acdaa714 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 404 len: 111 microversion: 2.1 time: 0.031126 Jun 15 14:49:12.862063 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 358/739] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:12 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 14:49:12.867645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3a341477-3099-48e1-9009-3fad65531c4a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '.version_select at 0x7f8f13db6b80>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:12.885258 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-3a341477-3099-48e1-9009-3fad65531c4a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1290012804" status: 202 len: 0 microversion: 2.1 time: 0.021272 Jun 15 14:49:12.885823 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 382/740] 10.222.0.57 () {58 vars in 1220 bytes} [Wed Jun 15 14:49:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1290012804 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:49:13.516083 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-2d0323e3-f02a-41ab-8211-7b03bfa1b6bd tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Action: 'create', calling method: .version_select at 0x7f8f13678790>, body: {"keypair": {"name": "tempest-keypair-1426052754", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpa+flbmcUrB9wG1kxWaCWIaO5/pYaywptIMy++0xhJhNAnz8I94Vsx2UTtpx+oXqy8X27U+2eE0283bC1wTOOhRDLpU/4NtqpgzwA6Mj5YdTiplqjGXqnnFq4BhfgrLw=="}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:13.530790 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-2d0323e3-f02a-41ab-8211-7b03bfa1b6bd tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Getting quotas for project 0c12c8e1398843eca8746543a0684841. Resources: {'key_pairs'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:49:13.534519 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-2d0323e3-f02a-41ab-8211-7b03bfa1b6bd tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Getting quotas for user 28ff37865a9b49ec8601140fca00a627 and project 0c12c8e1398843eca8746543a0684841. Resources: {'key_pairs'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:49:13.555626 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-2d0323e3-f02a-41ab-8211-7b03bfa1b6bd tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043405 Jun 15 14:49:13.556203 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 359/741] 10.222.0.57 () {60 vars in 1158 bytes} [Wed Jun 15 14:49:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:14.782359 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-ca192ceb-e503-4f39-8c05-0fbcccfb2a6b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1179574262", "imageRef": "e18802bf-9dac-462c-88ba-5cce79043279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9d6c1cb5-f05b-4061-8227-1b062e46210a"}], "security_groups": [{"name": "tempest-securitygroup--993474867"}], "key_name": "tempest-keypair-1426052754", "user_data": "}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:14.882460 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.network.neutron [None req-ca192ceb-e503-4f39-8c05-0fbcccfb2a6b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] validate_networks() for [('9d6c1cb5-f05b-4061-8227-1b062e46210a', None, None, None, None, None)] {{(pid=124219) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:49:15.295457 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-ca192ceb-e503-4f39-8c05-0fbcccfb2a6b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Flavor limits 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:49:15.295880 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-ca192ceb-e503-4f39-8c05-0fbcccfb2a6b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Image limits 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:49:15.296347 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-ca192ceb-e503-4f39-8c05-0fbcccfb2a6b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Flavor pref 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:49:15.296754 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-ca192ceb-e503-4f39-8c05-0fbcccfb2a6b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Image pref 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:49:15.297195 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-ca192ceb-e503-4f39-8c05-0fbcccfb2a6b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:49:15.305881 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ca192ceb-e503-4f39-8c05-0fbcccfb2a6b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:15.306808 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ca192ceb-e503-4f39-8c05-0fbcccfb2a6b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:15.308076 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ca192ceb-e503-4f39-8c05-0fbcccfb2a6b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:15.308511 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ca192ceb-e503-4f39-8c05-0fbcccfb2a6b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:15.327249 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-ca192ceb-e503-4f39-8c05-0fbcccfb2a6b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Getting quotas for project 0c12c8e1398843eca8746543a0684841. Resources: {'cores', 'instances', 'ram'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:49:15.331162 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-ca192ceb-e503-4f39-8c05-0fbcccfb2a6b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Getting quotas for user 28ff37865a9b49ec8601140fca00a627 and project 0c12c8e1398843eca8746543a0684841. Resources: {'cores', 'instances', 'ram'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:49:15.342429 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-ca192ceb-e503-4f39-8c05-0fbcccfb2a6b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Going to run 1 instances... {{(pid=124219) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:49:15.344658 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-ca192ceb-e503-4f39-8c05-0fbcccfb2a6b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e18802bf-9dac-462c-88ba-5cce79043279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124219) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:49:15.391081 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ca192ceb-e503-4f39-8c05-0fbcccfb2a6b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [484ad678-cfec-4e8f-ade6-a3196197f485] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 15 14:49:16.399697 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO oslo.messaging._drivers.impl_rabbit [None req-ca192ceb-e503-4f39-8c05-0fbcccfb2a6b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [484ad678-cfec-4e8f-ade6-a3196197f485] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 42434. Jun 15 14:49:16.405344 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-ca192ceb-e503-4f39-8c05-0fbcccfb2a6b tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.627268 Jun 15 14:49:16.406052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 383/742] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 14:49:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 1629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:49:16.416244 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-ac95af12-f78f-4a79-a367-d81930afeb4d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:16.416861 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-ac95af12-f78f-4a79-a367-d81930afeb4d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:16.471703 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ac95af12-f78f-4a79-a367-d81930afeb4d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:16.478481 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-ac95af12-f78f-4a79-a367-d81930afeb4d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb" status: 200 len: 1238 microversion: 2.1 time: 0.066481 Jun 15 14:49:16.479036 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 360/743] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:16 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:17.495957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e1d7a6d9-ef0d-4935-9897-0749078ca138 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:17.496565 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-e1d7a6d9-ef0d-4935-9897-0749078ca138 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:17.551398 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e1d7a6d9-ef0d-4935-9897-0749078ca138 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:17.558625 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-e1d7a6d9-ef0d-4935-9897-0749078ca138 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb" status: 200 len: 1238 microversion: 2.1 time: 0.067406 Jun 15 14:49:17.559181 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 384/744] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:17 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:18.574812 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6d350cb3-7d2a-4051-ba13-605503c7f3da tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:18.575476 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6d350cb3-7d2a-4051-ba13-605503c7f3da tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:18.578018 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:18.632512 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6d350cb3-7d2a-4051-ba13-605503c7f3da tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:18.639429 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-6d350cb3-7d2a-4051-ba13-605503c7f3da tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb" status: 200 len: 1238 microversion: 2.1 time: 0.068415 Jun 15 14:49:18.639993 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 361/745] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:18 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:19.656573 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-a0b9dbdc-9dd8-4117-9c9e-0b2dabf997cb tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:19.657190 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-a0b9dbdc-9dd8-4117-9c9e-0b2dabf997cb tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:19.715734 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-a0b9dbdc-9dd8-4117-9c9e-0b2dabf997cb tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:19.722752 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-a0b9dbdc-9dd8-4117-9c9e-0b2dabf997cb tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb" status: 200 len: 1238 microversion: 2.1 time: 0.070055 Jun 15 14:49:19.723326 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 385/746] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:19 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:20.739898 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6d8c3141-a2cc-4981-95b4-406463697505 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:20.740419 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6d8c3141-a2cc-4981-95b4-406463697505 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:20.747575 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6d8c3141-a2cc-4981-95b4-406463697505 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:20.748022 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6d8c3141-a2cc-4981-95b4-406463697505 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:20.748781 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6d8c3141-a2cc-4981-95b4-406463697505 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:20.749218 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6d8c3141-a2cc-4981-95b4-406463697505 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:20.809230 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6d8c3141-a2cc-4981-95b4-406463697505 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:20.817203 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-6d8c3141-a2cc-4981-95b4-406463697505 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb" status: 200 len: 1242 microversion: 2.1 time: 0.081256 Jun 15 14:49:20.817777 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 362/747] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:20 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:21.835168 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-7a2af39b-9640-401a-8e5c-2e63a8b70218 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:21.835791 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-7a2af39b-9640-401a-8e5c-2e63a8b70218 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:21.844032 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7a2af39b-9640-401a-8e5c-2e63a8b70218 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:21.844356 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7a2af39b-9640-401a-8e5c-2e63a8b70218 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:21.845527 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7a2af39b-9640-401a-8e5c-2e63a8b70218 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:21.845882 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7a2af39b-9640-401a-8e5c-2e63a8b70218 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:21.945126 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-7a2af39b-9640-401a-8e5c-2e63a8b70218 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:21.952572 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-7a2af39b-9640-401a-8e5c-2e63a8b70218 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb" status: 200 len: 1296 microversion: 2.1 time: 0.121762 Jun 15 14:49:21.953151 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 386/748] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:21 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb => generated 1296 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:22.969158 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-dc255940-d89a-4b29-8b20-6f01c33c540e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:22.969814 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-dc255940-d89a-4b29-8b20-6f01c33c540e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:22.976677 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-dc255940-d89a-4b29-8b20-6f01c33c540e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:22.977163 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-dc255940-d89a-4b29-8b20-6f01c33c540e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:22.978025 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-dc255940-d89a-4b29-8b20-6f01c33c540e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:22.978998 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-dc255940-d89a-4b29-8b20-6f01c33c540e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:22.983584 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:23.064115 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-2b33cb5f-fc08-4a12-8ca0-52ff7783c1b1 req-d537fbf6-eee6-4eda-9570-129a9b850885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "614be0bb-764c-4e45-ab82-656b13ded3bb", "tag": "c504934d-47ed-419a-8f48-11ec467c239b"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:23.073614 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-2b33cb5f-fc08-4a12-8ca0-52ff7783c1b1 req-d537fbf6-eee6-4eda-9570-129a9b850885 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:23.074098 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-2b33cb5f-fc08-4a12-8ca0-52ff7783c1b1 req-d537fbf6-eee6-4eda-9570-129a9b850885 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:23.086380 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-2b33cb5f-fc08-4a12-8ca0-52ff7783c1b1 req-d537fbf6-eee6-4eda-9570-129a9b850885 service nova] Creating event network-changed:c504934d-47ed-419a-8f48-11ec467c239b for instance 614be0bb-764c-4e45-ab82-656b13ded3bb on hv-cinder-84327 Jun 15 14:49:23.092333 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-2b33cb5f-fc08-4a12-8ca0-52ff7783c1b1 req-d537fbf6-eee6-4eda-9570-129a9b850885 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031784 Jun 15 14:49:23.093467 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 387/749] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:49:23.150546 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-dc255940-d89a-4b29-8b20-6f01c33c540e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:23.159571 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-dc255940-d89a-4b29-8b20-6f01c33c540e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb" status: 200 len: 1363 microversion: 2.1 time: 0.194290 Jun 15 14:49:23.160628 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 363/750] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:22 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:24.178635 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-ff4eea0f-cec4-4a7f-a8b5-7cd6b43cbef4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:24.179371 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-ff4eea0f-cec4-4a7f-a8b5-7cd6b43cbef4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:24.185653 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ff4eea0f-cec4-4a7f-a8b5-7cd6b43cbef4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:24.186131 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ff4eea0f-cec4-4a7f-a8b5-7cd6b43cbef4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:24.186888 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ff4eea0f-cec4-4a7f-a8b5-7cd6b43cbef4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:24.187327 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ff4eea0f-cec4-4a7f-a8b5-7cd6b43cbef4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:24.314775 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-ff4eea0f-cec4-4a7f-a8b5-7cd6b43cbef4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:24.322727 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-ff4eea0f-cec4-4a7f-a8b5-7cd6b43cbef4 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb" status: 200 len: 1363 microversion: 2.1 time: 0.149121 Jun 15 14:49:24.323299 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 388/751] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:24 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:25.339982 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-96a5c57b-e10f-4323-935b-8aaf2d5ec03e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:25.340929 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-96a5c57b-e10f-4323-935b-8aaf2d5ec03e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:25.348687 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-96a5c57b-e10f-4323-935b-8aaf2d5ec03e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:25.349071 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-96a5c57b-e10f-4323-935b-8aaf2d5ec03e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:25.349900 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-96a5c57b-e10f-4323-935b-8aaf2d5ec03e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:25.350525 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-96a5c57b-e10f-4323-935b-8aaf2d5ec03e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:25.483370 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-96a5c57b-e10f-4323-935b-8aaf2d5ec03e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:25.490762 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-96a5c57b-e10f-4323-935b-8aaf2d5ec03e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb" status: 200 len: 1363 microversion: 2.1 time: 0.155191 Jun 15 14:49:25.491310 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 364/752] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:25 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:26.508067 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-eaf78f91-365d-461e-b541-be5e56f86816 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:26.508687 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-eaf78f91-365d-461e-b541-be5e56f86816 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:26.511686 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=2 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:26.517152 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-eaf78f91-365d-461e-b541-be5e56f86816 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:26.517609 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-eaf78f91-365d-461e-b541-be5e56f86816 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:26.518410 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-eaf78f91-365d-461e-b541-be5e56f86816 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:26.518856 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-eaf78f91-365d-461e-b541-be5e56f86816 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:26.646572 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-eaf78f91-365d-461e-b541-be5e56f86816 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:26.654693 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-eaf78f91-365d-461e-b541-be5e56f86816 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb" status: 200 len: 1363 microversion: 2.1 time: 0.150475 Jun 15 14:49:26.655256 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 389/753] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:26 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:27.671345 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-3ec6910e-3887-49ee-860a-81360a472fb9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:27.671960 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-3ec6910e-3887-49ee-860a-81360a472fb9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:27.678383 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3ec6910e-3887-49ee-860a-81360a472fb9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:27.678830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3ec6910e-3887-49ee-860a-81360a472fb9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:27.679588 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3ec6910e-3887-49ee-860a-81360a472fb9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:27.680029 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3ec6910e-3887-49ee-860a-81360a472fb9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:27.811671 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-3ec6910e-3887-49ee-860a-81360a472fb9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:27.819020 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-3ec6910e-3887-49ee-860a-81360a472fb9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb" status: 200 len: 1363 microversion: 2.1 time: 0.151475 Jun 15 14:49:27.819578 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 365/754] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:27 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:28.205627 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-18c846c2-a959-4d44-97bf-d68fe98d3b88 req-c362c708-c30b-4185-ba82-3fac99caf801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614be0bb-764c-4e45-ab82-656b13ded3bb", "name": "network-vif-plugged", "status": "completed", "tag": "c504934d-47ed-419a-8f48-11ec467c239b"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:28.214661 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-18c846c2-a959-4d44-97bf-d68fe98d3b88 req-c362c708-c30b-4185-ba82-3fac99caf801 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:28.214987 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-18c846c2-a959-4d44-97bf-d68fe98d3b88 req-c362c708-c30b-4185-ba82-3fac99caf801 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:28.226300 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-18c846c2-a959-4d44-97bf-d68fe98d3b88 req-c362c708-c30b-4185-ba82-3fac99caf801 service nova] Creating event network-vif-plugged:c504934d-47ed-419a-8f48-11ec467c239b for instance 614be0bb-764c-4e45-ab82-656b13ded3bb on hv-cinder-84327 Jun 15 14:49:28.231811 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-18c846c2-a959-4d44-97bf-d68fe98d3b88 req-c362c708-c30b-4185-ba82-3fac99caf801 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029801 Jun 15 14:49:28.232399 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 390/755] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:28.836426 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-60488368-3cf2-47ab-ba01-5a73612277c9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:28.837042 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-60488368-3cf2-47ab-ba01-5a73612277c9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:28.838959 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=8 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:28.844726 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-60488368-3cf2-47ab-ba01-5a73612277c9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:28.845174 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-60488368-3cf2-47ab-ba01-5a73612277c9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:28.846049 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-60488368-3cf2-47ab-ba01-5a73612277c9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:28.846497 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-60488368-3cf2-47ab-ba01-5a73612277c9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:28.973304 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-60488368-3cf2-47ab-ba01-5a73612277c9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:28.981370 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-60488368-3cf2-47ab-ba01-5a73612277c9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb" status: 200 len: 1363 microversion: 2.1 time: 0.148815 Jun 15 14:49:28.981969 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 366/756] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:28 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:29.995880 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=10 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:30.000031 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-23749113-27c7-4638-b292-d8bc06817d19 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:30.000730 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-23749113-27c7-4638-b292-d8bc06817d19 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:30.007210 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-23749113-27c7-4638-b292-d8bc06817d19 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:30.007663 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-23749113-27c7-4638-b292-d8bc06817d19 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:30.008420 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-23749113-27c7-4638-b292-d8bc06817d19 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:30.008864 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-23749113-27c7-4638-b292-d8bc06817d19 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:30.138062 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-23749113-27c7-4638-b292-d8bc06817d19 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:30.145373 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-23749113-27c7-4638-b292-d8bc06817d19 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb" status: 200 len: 1363 microversion: 2.1 time: 0.151072 Jun 15 14:49:30.145969 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 391/757] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:29 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:31.162508 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-3dd610b8-1e1c-4550-963b-454cc39ce830 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:31.163118 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-3dd610b8-1e1c-4550-963b-454cc39ce830 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:31.170438 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3dd610b8-1e1c-4550-963b-454cc39ce830 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:31.170884 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3dd610b8-1e1c-4550-963b-454cc39ce830 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:31.171642 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3dd610b8-1e1c-4550-963b-454cc39ce830 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:31.172071 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3dd610b8-1e1c-4550-963b-454cc39ce830 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:31.304567 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-3dd610b8-1e1c-4550-963b-454cc39ce830 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:31.311978 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-3dd610b8-1e1c-4550-963b-454cc39ce830 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb" status: 200 len: 1549 microversion: 2.1 time: 0.153419 Jun 15 14:49:31.312540 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 367/758] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:31 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:31.331347 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-07afb21f-fa69-4a93-b2d9-e5c7f9ab992d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:31.331904 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-07afb21f-fa69-4a93-b2d9-e5c7f9ab992d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:31.339404 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-07afb21f-fa69-4a93-b2d9-e5c7f9ab992d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:31.339847 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-07afb21f-fa69-4a93-b2d9-e5c7f9ab992d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:31.340604 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-07afb21f-fa69-4a93-b2d9-e5c7f9ab992d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:31.341033 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-07afb21f-fa69-4a93-b2d9-e5c7f9ab992d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:31.418950 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-07afb21f-fa69-4a93-b2d9-e5c7f9ab992d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091337 Jun 15 14:49:31.419539 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 392/759] 10.222.0.57 () {58 vars in 1274 bytes} [Wed Jun 15 14:49:31 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:32.310817 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-1030c6e5-71ed-4dc8-9ba1-24c10a19d127 req-bad9f20f-a265-49cc-ac94-857235054fee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "614be0bb-764c-4e45-ab82-656b13ded3bb", "tag": "c504934d-47ed-419a-8f48-11ec467c239b"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:32.320366 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-1030c6e5-71ed-4dc8-9ba1-24c10a19d127 req-bad9f20f-a265-49cc-ac94-857235054fee service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:32.320938 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-1030c6e5-71ed-4dc8-9ba1-24c10a19d127 req-bad9f20f-a265-49cc-ac94-857235054fee service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:32.332573 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-1030c6e5-71ed-4dc8-9ba1-24c10a19d127 req-bad9f20f-a265-49cc-ac94-857235054fee service nova] Creating event network-changed:c504934d-47ed-419a-8f48-11ec467c239b for instance 614be0bb-764c-4e45-ab82-656b13ded3bb on hv-cinder-84327 Jun 15 14:49:32.337810 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-1030c6e5-71ed-4dc8-9ba1-24c10a19d127 req-bad9f20f-a265-49cc-ac94-857235054fee service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030595 Jun 15 14:49:32.339689 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 368/760] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:49:41.927926 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:41.928678 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=60 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:41.933292 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-bc6bc43c-7bf7-44fb-990a-3c4ddbc6fbbe tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:41.933897 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-bc6bc43c-7bf7-44fb-990a-3c4ddbc6fbbe tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:41.941510 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bc6bc43c-7bf7-44fb-990a-3c4ddbc6fbbe tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:41.941987 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bc6bc43c-7bf7-44fb-990a-3c4ddbc6fbbe tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:41.942757 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bc6bc43c-7bf7-44fb-990a-3c4ddbc6fbbe tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:41.943198 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bc6bc43c-7bf7-44fb-990a-3c4ddbc6fbbe tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:42.026465 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.objects.instance [None req-bc6bc43c-7bf7-44fb-990a-3c4ddbc6fbbe tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lazy-loading 'services' on Instance uuid c7677949-b0c4-4f8a-bf16-26a4c639c344 {{(pid=124219) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:49:42.099462 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-bc6bc43c-7bf7-44fb-990a-3c4ddbc6fbbe tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344/os-volume_attachments/5fddacf2-4e45-4710-aca6-4157a311e44f" status: 202 len: 0 microversion: 2.1 time: 0.172693 Jun 15 14:49:42.100115 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 393/761] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Jun 15 14:49:41 2022] DELETE /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344/os-volume_attachments/5fddacf2-4e45-4710-aca6-4157a311e44f => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:49:42.109968 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-e0cbf55e-bf26-4da9-b525-a8adb012ef7f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:42.110962 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-e0cbf55e-bf26-4da9-b525-a8adb012ef7f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:42.117295 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e0cbf55e-bf26-4da9-b525-a8adb012ef7f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:42.117775 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e0cbf55e-bf26-4da9-b525-a8adb012ef7f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:42.118541 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e0cbf55e-bf26-4da9-b525-a8adb012ef7f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:42.118972 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e0cbf55e-bf26-4da9-b525-a8adb012ef7f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:42.151020 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-e0cbf55e-bf26-4da9-b525-a8adb012ef7f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046169 Jun 15 14:49:42.151503 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 369/762] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 14:49:42 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:43.163934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-9f2c7091-1097-4ae1-89a4-0885dcbded40 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:43.164945 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-9f2c7091-1097-4ae1-89a4-0885dcbded40 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:43.171232 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9f2c7091-1097-4ae1-89a4-0885dcbded40 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:43.171678 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9f2c7091-1097-4ae1-89a4-0885dcbded40 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:43.172428 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9f2c7091-1097-4ae1-89a4-0885dcbded40 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:43.172865 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9f2c7091-1097-4ae1-89a4-0885dcbded40 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:43.204910 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-9f2c7091-1097-4ae1-89a4-0885dcbded40 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045559 Jun 15 14:49:43.205508 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 394/763] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 14:49:43 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:44.216795 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-307bcd14-e568-4bc7-b821-584450401856 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:44.217753 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-307bcd14-e568-4bc7-b821-584450401856 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:44.224346 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-307bcd14-e568-4bc7-b821-584450401856 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:44.224790 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-307bcd14-e568-4bc7-b821-584450401856 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:44.225544 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-307bcd14-e568-4bc7-b821-584450401856 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:44.226005 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-307bcd14-e568-4bc7-b821-584450401856 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:44.254544 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-307bcd14-e568-4bc7-b821-584450401856 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042070 Jun 15 14:49:44.255082 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 370/764] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 14:49:44 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 14:49:44.330040 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f9a4a1dd-a217-4488-ac3d-86bcb9721ac5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:44.330573 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f9a4a1dd-a217-4488-ac3d-86bcb9721ac5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:44.337197 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f9a4a1dd-a217-4488-ac3d-86bcb9721ac5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:44.337650 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f9a4a1dd-a217-4488-ac3d-86bcb9721ac5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:44.338442 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f9a4a1dd-a217-4488-ac3d-86bcb9721ac5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:44.338877 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f9a4a1dd-a217-4488-ac3d-86bcb9721ac5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:44.364285 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f9a4a1dd-a217-4488-ac3d-86bcb9721ac5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Going to try to terminate instance {{(pid=124219) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:49:44.436132 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f9a4a1dd-a217-4488-ac3d-86bcb9721ac5 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 204 len: 0 microversion: 2.1 time: 0.109957 Jun 15 14:49:44.439503 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 395/765] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:49:44 2022] DELETE /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 14:49:44.444849 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a487897a-8c28-4ba8-b3c9-6a6c4da0e3c3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:44.445522 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a487897a-8c28-4ba8-b3c9-6a6c4da0e3c3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:44.452860 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a487897a-8c28-4ba8-b3c9-6a6c4da0e3c3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:44.453320 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a487897a-8c28-4ba8-b3c9-6a6c4da0e3c3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:44.454157 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a487897a-8c28-4ba8-b3c9-6a6c4da0e3c3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:44.455346 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a487897a-8c28-4ba8-b3c9-6a6c4da0e3c3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:44.586593 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a487897a-8c28-4ba8-b3c9-6a6c4da0e3c3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:44.594943 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a487897a-8c28-4ba8-b3c9-6a6c4da0e3c3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1688 microversion: 2.1 time: 0.154200 Jun 15 14:49:44.595504 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 371/766] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:44 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:44.836153 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-79b99ba9-e937-44cd-b737-51748971d0fe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:44.836658 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-79b99ba9-e937-44cd-b737-51748971d0fe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:44.842996 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-79b99ba9-e937-44cd-b737-51748971d0fe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:44.843454 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-79b99ba9-e937-44cd-b737-51748971d0fe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:44.844215 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-79b99ba9-e937-44cd-b737-51748971d0fe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:44.844652 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-79b99ba9-e937-44cd-b737-51748971d0fe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:44.867292 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-79b99ba9-e937-44cd-b737-51748971d0fe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a/ips" status: 200 len: 151 microversion: 2.20 time: 0.035499 Jun 15 14:49:44.867851 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 396/767] 10.222.0.57 () {60 vars in 1288 bytes} [Wed Jun 15 14:49:44 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:49:45.611998 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-d4c05c7d-2f5f-468f-9672-794b4e7717ba tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:45.612612 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-d4c05c7d-2f5f-468f-9672-794b4e7717ba tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:45.619144 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d4c05c7d-2f5f-468f-9672-794b4e7717ba tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:45.619597 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d4c05c7d-2f5f-468f-9672-794b4e7717ba tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:45.620359 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d4c05c7d-2f5f-468f-9672-794b4e7717ba tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:45.620797 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d4c05c7d-2f5f-468f-9672-794b4e7717ba tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:45.752806 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-d4c05c7d-2f5f-468f-9672-794b4e7717ba tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:45.760535 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-d4c05c7d-2f5f-468f-9672-794b4e7717ba tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1688 microversion: 2.1 time: 0.152283 Jun 15 14:49:45.761161 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 372/768] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:45 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:49:46.778446 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-fe03ab41-fdbc-4c65-9d14-c10ee2113fa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:46.779764 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-fe03ab41-fdbc-4c65-9d14-c10ee2113fa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:46.786192 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fe03ab41-fdbc-4c65-9d14-c10ee2113fa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:46.786633 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fe03ab41-fdbc-4c65-9d14-c10ee2113fa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:46.787383 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fe03ab41-fdbc-4c65-9d14-c10ee2113fa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:46.787812 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fe03ab41-fdbc-4c65-9d14-c10ee2113fa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:46.916198 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-fe03ab41-fdbc-4c65-9d14-c10ee2113fa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:46.923849 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-fe03ab41-fdbc-4c65-9d14-c10ee2113fa7 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1688 microversion: 2.1 time: 0.149531 Jun 15 14:49:46.924417 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 397/769] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:46 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:47.941290 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-61272d11-d3d2-4030-a4fc-aa9db3c09b3c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:47.941951 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-61272d11-d3d2-4030-a4fc-aa9db3c09b3c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:47.948492 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-61272d11-d3d2-4030-a4fc-aa9db3c09b3c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:47.948941 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-61272d11-d3d2-4030-a4fc-aa9db3c09b3c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:47.949784 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-61272d11-d3d2-4030-a4fc-aa9db3c09b3c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:47.950231 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-61272d11-d3d2-4030-a4fc-aa9db3c09b3c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:48.079758 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-61272d11-d3d2-4030-a4fc-aa9db3c09b3c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:48.087102 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-61272d11-d3d2-4030-a4fc-aa9db3c09b3c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1688 microversion: 2.1 time: 0.149746 Jun 15 14:49:48.087658 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 373/770] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:47 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:49.104771 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-48a16bbd-ad9e-4128-a8a2-e7945f179652 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:49.105382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-48a16bbd-ad9e-4128-a8a2-e7945f179652 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:49.112701 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-48a16bbd-ad9e-4128-a8a2-e7945f179652 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:49.113191 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-48a16bbd-ad9e-4128-a8a2-e7945f179652 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:49.113944 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-48a16bbd-ad9e-4128-a8a2-e7945f179652 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:49.114386 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-48a16bbd-ad9e-4128-a8a2-e7945f179652 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:49.248281 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-48a16bbd-ad9e-4128-a8a2-e7945f179652 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:49.256067 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-48a16bbd-ad9e-4128-a8a2-e7945f179652 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1688 microversion: 2.1 time: 0.155402 Jun 15 14:49:49.256634 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 398/771] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:49 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:49.322584 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-f922c82c-69d7-45bb-9f76-e51ec1d3cc11 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:49.323148 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-f922c82c-69d7-45bb-9f76-e51ec1d3cc11 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:49.326532 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=28 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:49.332104 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f922c82c-69d7-45bb-9f76-e51ec1d3cc11 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:49.332546 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f922c82c-69d7-45bb-9f76-e51ec1d3cc11 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:49.333305 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f922c82c-69d7-45bb-9f76-e51ec1d3cc11 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:49.333770 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f922c82c-69d7-45bb-9f76-e51ec1d3cc11 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:49.356101 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.objects.instance [None req-f922c82c-69d7-45bb-9f76-e51ec1d3cc11 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lazy-loading 'flavor' on Instance uuid 7d0cbdc8-d87b-4ce4-97d1-59aca342287a {{(pid=124220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:49:49.614598 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-f922c82c-69d7-45bb-9f76-e51ec1d3cc11 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "POST /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a/action" status: 202 len: 0 microversion: 2.20 time: 0.296069 Jun 15 14:49:49.615324 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 374/772] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Jun 15 14:49:49 2022] POST /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:49:49.623255 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-2dcf8a07-9e0e-4b10-8f99-8522f5e0bf1a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:49.624522 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-2dcf8a07-9e0e-4b10-8f99-8522f5e0bf1a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:49.630772 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2dcf8a07-9e0e-4b10-8f99-8522f5e0bf1a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:49.631227 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2dcf8a07-9e0e-4b10-8f99-8522f5e0bf1a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:49.631996 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2dcf8a07-9e0e-4b10-8f99-8522f5e0bf1a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:49.632437 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2dcf8a07-9e0e-4b10-8f99-8522f5e0bf1a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:49.764261 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-2dcf8a07-9e0e-4b10-8f99-8522f5e0bf1a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:49.773284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-2dcf8a07-9e0e-4b10-8f99-8522f5e0bf1a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:49.774847 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-2dcf8a07-9e0e-4b10-8f99-8522f5e0bf1a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:49.776081 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-2dcf8a07-9e0e-4b10-8f99-8522f5e0bf1a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1720 microversion: 2.20 time: 0.156711 Jun 15 14:49:49.776625 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 399/773] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:49 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:50.274084 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-da35c0ea-94db-42af-bb42-a61e6f0d4645 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:50.274800 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-da35c0ea-94db-42af-bb42-a61e6f0d4645 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:50.281166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-da35c0ea-94db-42af-bb42-a61e6f0d4645 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:50.281618 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-da35c0ea-94db-42af-bb42-a61e6f0d4645 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:50.282500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-da35c0ea-94db-42af-bb42-a61e6f0d4645 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:50.282945 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-da35c0ea-94db-42af-bb42-a61e6f0d4645 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:50.293842 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-9b27ac45-868f-472a-9221-243b6caf72e0 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:50.294359 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-9b27ac45-868f-472a-9221-243b6caf72e0 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:50.301164 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9b27ac45-868f-472a-9221-243b6caf72e0 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:50.301775 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9b27ac45-868f-472a-9221-243b6caf72e0 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:50.302631 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9b27ac45-868f-472a-9221-243b6caf72e0 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:50.303127 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9b27ac45-868f-472a-9221-243b6caf72e0 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:50.335481 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-9b27ac45-868f-472a-9221-243b6caf72e0 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Going to try to terminate instance {{(pid=124219) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:49:50.425516 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-9b27ac45-868f-472a-9221-243b6caf72e0 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 204 len: 0 microversion: 2.1 time: 0.135304 Jun 15 14:49:50.429334 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 400/774] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:49:50 2022] DELETE /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 14:49:50.432094 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-da35c0ea-94db-42af-bb42-a61e6f0d4645 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:50.437683 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-578dad55-470f-457c-9adb-42fa4b6f0b5e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:50.438430 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-578dad55-470f-457c-9adb-42fa4b6f0b5e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:50.441490 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-da35c0ea-94db-42af-bb42-a61e6f0d4645 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1688 microversion: 2.1 time: 0.171533 Jun 15 14:49:50.447902 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-578dad55-470f-457c-9adb-42fa4b6f0b5e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:50.447902 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-578dad55-470f-457c-9adb-42fa4b6f0b5e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:50.447902 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-578dad55-470f-457c-9adb-42fa4b6f0b5e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:50.447902 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-578dad55-470f-457c-9adb-42fa4b6f0b5e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:50.451904 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 375/775] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:50 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1688 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:50.683737 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-578dad55-470f-457c-9adb-42fa4b6f0b5e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:50.691926 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-578dad55-470f-457c-9adb-42fa4b6f0b5e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1578 microversion: 2.1 time: 0.260047 Jun 15 14:49:50.692501 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 401/776] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:50 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1578 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:50.801805 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-ea9c656e-088a-4fd1-8215-5f86e4e0dc85 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:50.802076 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-ea9c656e-088a-4fd1-8215-5f86e4e0dc85 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:50.808385 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ea9c656e-088a-4fd1-8215-5f86e4e0dc85 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:50.808844 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ea9c656e-088a-4fd1-8215-5f86e4e0dc85 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:50.809625 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ea9c656e-088a-4fd1-8215-5f86e4e0dc85 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:50.810094 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ea9c656e-088a-4fd1-8215-5f86e4e0dc85 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:50.946462 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ea9c656e-088a-4fd1-8215-5f86e4e0dc85 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:50.954668 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ea9c656e-088a-4fd1-8215-5f86e4e0dc85 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:50.956209 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ea9c656e-088a-4fd1-8215-5f86e4e0dc85 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:50.957368 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-ea9c656e-088a-4fd1-8215-5f86e4e0dc85 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1720 microversion: 2.20 time: 0.166056 Jun 15 14:49:50.957977 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 376/777] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:50 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:51.070191 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-7493b279-01b4-4059-be46-52b01b7341e9 req-80b8295c-41be-43f7-95b0-d95ffbbf6a20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7677949-b0c4-4f8a-bf16-26a4c639c344", "name": "network-vif-deleted", "tag": "faff7f9d-2ca1-439d-8ffd-5a9dad77ee86"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:51.079776 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-7493b279-01b4-4059-be46-52b01b7341e9 req-80b8295c-41be-43f7-95b0-d95ffbbf6a20 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:51.080158 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-7493b279-01b4-4059-be46-52b01b7341e9 req-80b8295c-41be-43f7-95b0-d95ffbbf6a20 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:51.091394 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-7493b279-01b4-4059-be46-52b01b7341e9 req-80b8295c-41be-43f7-95b0-d95ffbbf6a20 service nova] Creating event network-vif-deleted:faff7f9d-2ca1-439d-8ffd-5a9dad77ee86 for instance c7677949-b0c4-4f8a-bf16-26a4c639c344 on hv-cinder-84327 Jun 15 14:49:51.097186 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-7493b279-01b4-4059-be46-52b01b7341e9 req-80b8295c-41be-43f7-95b0-d95ffbbf6a20 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030757 Jun 15 14:49:51.098087 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 402/778] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:51.459011 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-38d9ede9-6c6e-4f7f-9f2b-c99e765f3ede tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:51.459670 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-38d9ede9-6c6e-4f7f-9f2b-c99e765f3ede tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:51.466203 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-38d9ede9-6c6e-4f7f-9f2b-c99e765f3ede tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:51.466657 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-38d9ede9-6c6e-4f7f-9f2b-c99e765f3ede tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:51.467459 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-38d9ede9-6c6e-4f7f-9f2b-c99e765f3ede tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:51.467925 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-38d9ede9-6c6e-4f7f-9f2b-c99e765f3ede tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:51.532665 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-38d9ede9-6c6e-4f7f-9f2b-c99e765f3ede tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:51.540309 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-38d9ede9-6c6e-4f7f-9f2b-c99e765f3ede tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1620 microversion: 2.1 time: 0.085191 Jun 15 14:49:51.540873 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 377/779] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:51 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1620 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:51.710139 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-39d087fb-4ced-4cf4-85d4-24cc89fa9651 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:51.710831 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-39d087fb-4ced-4cf4-85d4-24cc89fa9651 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:51.717043 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-39d087fb-4ced-4cf4-85d4-24cc89fa9651 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:51.717561 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-39d087fb-4ced-4cf4-85d4-24cc89fa9651 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:51.718984 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-39d087fb-4ced-4cf4-85d4-24cc89fa9651 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:51.719417 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-39d087fb-4ced-4cf4-85d4-24cc89fa9651 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:51.856673 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-39d087fb-4ced-4cf4-85d4-24cc89fa9651 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:51.865598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-39d087fb-4ced-4cf4-85d4-24cc89fa9651 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1578 microversion: 2.1 time: 0.160071 Jun 15 14:49:51.866392 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 403/780] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:51 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:51.976484 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-9f4a4a0a-47f7-4693-8018-e1eb25e47f6a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:51.977098 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-9f4a4a0a-47f7-4693-8018-e1eb25e47f6a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:51.983809 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9f4a4a0a-47f7-4693-8018-e1eb25e47f6a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:51.984251 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9f4a4a0a-47f7-4693-8018-e1eb25e47f6a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:51.985034 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9f4a4a0a-47f7-4693-8018-e1eb25e47f6a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:51.985465 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9f4a4a0a-47f7-4693-8018-e1eb25e47f6a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:52.002365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:52.124161 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9f4a4a0a-47f7-4693-8018-e1eb25e47f6a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:52.133108 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9f4a4a0a-47f7-4693-8018-e1eb25e47f6a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:52.134622 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9f4a4a0a-47f7-4693-8018-e1eb25e47f6a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:52.135820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-9f4a4a0a-47f7-4693-8018-e1eb25e47f6a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1720 microversion: 2.20 time: 0.163597 Jun 15 14:49:52.136567 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 378/781] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:51 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:52.557187 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-cf29b020-503c-4a4f-b4c5-16032c3756a8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:52.557836 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-cf29b020-503c-4a4f-b4c5-16032c3756a8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:52.563995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-cf29b020-503c-4a4f-b4c5-16032c3756a8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:52.564447 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-cf29b020-503c-4a4f-b4c5-16032c3756a8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:52.565209 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-cf29b020-503c-4a4f-b4c5-16032c3756a8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:52.565649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-cf29b020-503c-4a4f-b4c5-16032c3756a8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:52.627136 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-cf29b020-503c-4a4f-b4c5-16032c3756a8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:52.635167 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-cf29b020-503c-4a4f-b4c5-16032c3756a8 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 200 len: 1329 microversion: 2.1 time: 0.081763 Jun 15 14:49:52.635738 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 404/782] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:52 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 1329 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:52.883156 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-9fbbe0cf-ecc0-4f16-8d6a-f94593276e0e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:52.883771 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-9fbbe0cf-ecc0-4f16-8d6a-f94593276e0e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:52.890735 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9fbbe0cf-ecc0-4f16-8d6a-f94593276e0e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:52.891179 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9fbbe0cf-ecc0-4f16-8d6a-f94593276e0e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:52.891937 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9fbbe0cf-ecc0-4f16-8d6a-f94593276e0e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:52.892369 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9fbbe0cf-ecc0-4f16-8d6a-f94593276e0e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:53.028162 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9fbbe0cf-ecc0-4f16-8d6a-f94593276e0e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:53.036884 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-9fbbe0cf-ecc0-4f16-8d6a-f94593276e0e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1578 microversion: 2.1 time: 0.157369 Jun 15 14:49:53.037543 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 379/783] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:52 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:53.154121 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-117b4e21-87fd-4819-8579-d97838720106 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:53.154660 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-117b4e21-87fd-4819-8579-d97838720106 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:53.161752 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-117b4e21-87fd-4819-8579-d97838720106 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:53.162218 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-117b4e21-87fd-4819-8579-d97838720106 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:53.162987 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-117b4e21-87fd-4819-8579-d97838720106 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:53.163425 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-117b4e21-87fd-4819-8579-d97838720106 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:53.294393 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-117b4e21-87fd-4819-8579-d97838720106 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:53.302479 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-117b4e21-87fd-4819-8579-d97838720106 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:53.303978 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-117b4e21-87fd-4819-8579-d97838720106 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:53.305126 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-117b4e21-87fd-4819-8579-d97838720106 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1720 microversion: 2.20 time: 0.155166 Jun 15 14:49:53.305703 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 405/784] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:53 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:53.653224 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-365c56bf-9b4a-4fc6-aa5d-6cc86046a96a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:53.654018 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-365c56bf-9b4a-4fc6-aa5d-6cc86046a96a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: c7677949-b0c4-4f8a-bf16-26a4c639c344] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:53.663253 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-365c56bf-9b4a-4fc6-aa5d-6cc86046a96a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:53.663786 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-365c56bf-9b4a-4fc6-aa5d-6cc86046a96a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:53.664749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-365c56bf-9b4a-4fc6-aa5d-6cc86046a96a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:53.665183 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-365c56bf-9b4a-4fc6-aa5d-6cc86046a96a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:53.680803 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.wsgi [None req-365c56bf-9b4a-4fc6-aa5d-6cc86046a96a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] HTTP exception thrown: Instance c7677949-b0c4-4f8a-bf16-26a4c639c344 could not be found. Jun 15 14:49:53.682392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-365c56bf-9b4a-4fc6-aa5d-6cc86046a96a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Request method failure captured: Jun 15 14:49:53.682392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: request: GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 HTTP/1.1 Jun 15 14:49:53.682392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept: application/json Jun 15 14:49:53.682392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept-Encoding: identity Jun 15 14:49:53.682392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Connection: close Jun 15 14:49:53.682392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Length: 0 Jun 15 14:49:53.682392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Type: application/json Jun 15 14:49:53.682392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Host: 10.222.0.57 Jun 15 14:49:53.682392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Openstack-System-Scope: None Jun 15 14:49:53.682392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: User-Agent: python-urllib3/1.26.9 Jun 15 14:49:53.682392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Auth-Token: gAAAAABiqfAJ8wPnkqs_k4Bo8GSWGVuB1Ap-R1u4L7mH2U3HEuvWVNvlRBO_qyAD7QzOZMMEzF_zcaK0X4c1eXso_54pW74XDCCkghDRm0zR7H0M-gVJaO4FWuw9AQkWNKuoAF0zQpil6wRuiB3fOyyvDJwL5UyfZxFCESuQo14vuw2L05AA968 Jun 15 14:49:53.682392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Id: None Jun 15 14:49:53.682392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Name: None Jun 15 14:49:53.682392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Identity-Status: Confirmed Jun 15 14:49:53.682392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Is-Admin-Project: True Jun 15 14:49:53.682392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Id: default Jun 15 14:49:53.682392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Name: Default Jun 15 14:49:53.682392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Id: 26d36b3b04f046d3bee421c5987b965b Jun 15 14:49:53.682392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1197112882 Jun 15 14:49:53.682392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Role: member,reader Jun 15 14:49:53.682392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Roles: member,reader Jun 15 14:49:53.683786 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/26d36b3b04f046d3bee421c5987b965b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_26d36b3b04f046d3bee421c5987b965b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/26d36b3b04f046d3bee421c5987b965b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/26d36b3b04f046d3bee421c5987b965b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:49:53.683786 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1197112882 Jun 15 14:49:53.683786 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Id: 26d36b3b04f046d3bee421c5987b965b Jun 15 14:49:53.683786 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1197112882 Jun 15 14:49:53.683786 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User: tempest-ServerRescueNegativeTestJSON-1197112882-project Jun 15 14:49:53.683786 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Id: default Jun 15 14:49:53.683786 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Name: Default Jun 15 14:49:53.683786 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Id: ed7372fed3e14f3e98ca25d22a7c7a7e Jun 15 14:49:53.683786 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1197112882-project Jun 15 14:49:53.683786 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: method: > Jun 15 14:49:53.683786 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: exception: Instance c7677949-b0c4-4f8a-bf16-26a4c639c344 could not be found. Jun 15 14:49:53.683786 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: action_args: {'id': 'c7677949-b0c4-4f8a-bf16-26a4c639c344'} Jun 15 14:49:53.684550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:49:53.684550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:53.684550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:49:53.684550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:49:53.684550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:49:53.684550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:49:53.684550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:49:53.684550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:49:53.684550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:49:53.684550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:49:53.684550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7677949-b0c4-4f8a-bf16-26a4c639c344 could not be found. Jun 15 14:49:53.684550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:49:53.684550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:53.684550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:49:53.684550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:53.684550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:53.684550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:53.684550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:49:53.684550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:49:53.684550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:49:53.687033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:49:53.687033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:49:53.687033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:49:53.687033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:49:53.687033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:49:53.687033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:49:53.687033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:49:53.687033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7677949-b0c4-4f8a-bf16-26a4c639c344 could not be found. Jun 15 14:49:53.687033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:49:53.687033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:53.687033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:49:53.687033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:53.687033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:53.687033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:53.687033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:49:53.687033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:49:53.687033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7677949-b0c4-4f8a-bf16-26a4c639c344 could not be found. Jun 15 14:49:53.687033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:49:53.688782 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-365c56bf-9b4a-4fc6-aa5d-6cc86046a96a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Returning 404 to user: Instance c7677949-b0c4-4f8a-bf16-26a4c639c344 could not be found. {{(pid=124220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:49:53.688782 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-365c56bf-9b4a-4fc6-aa5d-6cc86046a96a tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344" status: 404 len: 111 microversion: 2.1 time: 0.035387 Jun 15 14:49:53.688782 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 380/785] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:53 2022] GET /compute/v2.1/servers/c7677949-b0c4-4f8a-bf16-26a4c639c344 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:49:53.693501 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-049e1b00-b583-4e18-b6d6-1e903a168956 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '.version_select at 0x7f8f13d91e50>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:53.710636 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-049e1b00-b583-4e18-b6d6-1e903a168956 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-946754658" status: 202 len: 0 microversion: 2.1 time: 0.020897 Jun 15 14:49:53.711517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 406/786] 10.222.0.57 () {58 vars in 1217 bytes} [Wed Jun 15 14:49:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-946754658 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:49:54.054805 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6e7da64f-3368-4019-9cf9-9320554b6032 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:54.055416 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6e7da64f-3368-4019-9cf9-9320554b6032 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:54.063048 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6e7da64f-3368-4019-9cf9-9320554b6032 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:54.063790 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6e7da64f-3368-4019-9cf9-9320554b6032 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:54.064944 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6e7da64f-3368-4019-9cf9-9320554b6032 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:54.065359 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6e7da64f-3368-4019-9cf9-9320554b6032 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:54.274248 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6e7da64f-3368-4019-9cf9-9320554b6032 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:54.283546 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-6e7da64f-3368-4019-9cf9-9320554b6032 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1578 microversion: 2.1 time: 0.232676 Jun 15 14:49:54.284226 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 381/787] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:54 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1578 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:54.325925 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-219b866d-74d5-44ef-b230-38ae9cd8a317 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:54.327709 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-219b866d-74d5-44ef-b230-38ae9cd8a317 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:54.333966 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-219b866d-74d5-44ef-b230-38ae9cd8a317 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:54.334424 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-219b866d-74d5-44ef-b230-38ae9cd8a317 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:54.335204 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-219b866d-74d5-44ef-b230-38ae9cd8a317 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:54.335649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-219b866d-74d5-44ef-b230-38ae9cd8a317 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:54.356135 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:54.578736 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-219b866d-74d5-44ef-b230-38ae9cd8a317 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:54.589931 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-c86eb00d-b487-4d2e-ac33-0657a6d6fb26 req-74406876-2aa8-4157-aaa1-ccde3712ecdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9104e014-d497-460a-8215-6439f0a2e521", "name": "network-vif-deleted", "tag": "bc9c90a6-a5e4-499e-bc4a-d030962cd9bc"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:54.604151 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-c86eb00d-b487-4d2e-ac33-0657a6d6fb26 req-74406876-2aa8-4157-aaa1-ccde3712ecdc service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:54.605185 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-219b866d-74d5-44ef-b230-38ae9cd8a317 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:54.605824 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-c86eb00d-b487-4d2e-ac33-0657a6d6fb26 req-74406876-2aa8-4157-aaa1-ccde3712ecdc service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:54.608311 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-219b866d-74d5-44ef-b230-38ae9cd8a317 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:54.614860 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-219b866d-74d5-44ef-b230-38ae9cd8a317 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1720 microversion: 2.20 time: 0.291215 Jun 15 14:49:54.615630 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 407/788] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:54 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1720 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:54.624877 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-c86eb00d-b487-4d2e-ac33-0657a6d6fb26 req-74406876-2aa8-4157-aaa1-ccde3712ecdc service nova] Creating event network-vif-deleted:bc9c90a6-a5e4-499e-bc4a-d030962cd9bc for instance 9104e014-d497-460a-8215-6439f0a2e521 on hv-cinder-84327 Jun 15 14:49:54.631775 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-c86eb00d-b487-4d2e-ac33-0657a6d6fb26 req-74406876-2aa8-4157-aaa1-ccde3712ecdc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045455 Jun 15 14:49:54.633585 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 382/789] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:55.303638 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-db2c8291-1f15-4e3f-a5be-1ccd6c08ed62 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:55.304257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-db2c8291-1f15-4e3f-a5be-1ccd6c08ed62 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:55.310432 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-db2c8291-1f15-4e3f-a5be-1ccd6c08ed62 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:55.310884 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-db2c8291-1f15-4e3f-a5be-1ccd6c08ed62 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:55.311679 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-db2c8291-1f15-4e3f-a5be-1ccd6c08ed62 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:55.312114 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-db2c8291-1f15-4e3f-a5be-1ccd6c08ed62 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:55.346978 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-db2c8291-1f15-4e3f-a5be-1ccd6c08ed62 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:55.347666 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-db2c8291-1f15-4e3f-a5be-1ccd6c08ed62 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:55.347864 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.objects.instance [None req-db2c8291-1f15-4e3f-a5be-1ccd6c08ed62 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lazy-loading 'fault' on Instance uuid 9104e014-d497-460a-8215-6439f0a2e521 {{(pid=124219) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:49:55.392865 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-db2c8291-1f15-4e3f-a5be-1ccd6c08ed62 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:55.400710 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-db2c8291-1f15-4e3f-a5be-1ccd6c08ed62 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 200 len: 1230 microversion: 2.1 time: 0.101566 Jun 15 14:49:55.401293 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 408/790] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:55 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:55.635137 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-11c4e53e-f8ed-46c4-8e32-af4b2ebfc899 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:55.635836 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-11c4e53e-f8ed-46c4-8e32-af4b2ebfc899 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:55.642590 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-11c4e53e-f8ed-46c4-8e32-af4b2ebfc899 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:55.643042 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-11c4e53e-f8ed-46c4-8e32-af4b2ebfc899 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:55.643810 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-11c4e53e-f8ed-46c4-8e32-af4b2ebfc899 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:55.644278 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-11c4e53e-f8ed-46c4-8e32-af4b2ebfc899 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:55.788321 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-11c4e53e-f8ed-46c4-8e32-af4b2ebfc899 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:55.796699 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-11c4e53e-f8ed-46c4-8e32-af4b2ebfc899 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:55.798401 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-11c4e53e-f8ed-46c4-8e32-af4b2ebfc899 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:55.799560 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-11c4e53e-f8ed-46c4-8e32-af4b2ebfc899 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1720 microversion: 2.20 time: 0.169154 Jun 15 14:49:55.800105 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 383/791] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:55 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:56.418083 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-fe698d3f-fee2-41d7-b04e-1f44062ef611 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:56.418690 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-fe698d3f-fee2-41d7-b04e-1f44062ef611 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:56.425789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fe698d3f-fee2-41d7-b04e-1f44062ef611 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:56.426184 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fe698d3f-fee2-41d7-b04e-1f44062ef611 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:56.426940 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fe698d3f-fee2-41d7-b04e-1f44062ef611 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:56.427373 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fe698d3f-fee2-41d7-b04e-1f44062ef611 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:56.441309 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-fe698d3f-fee2-41d7-b04e-1f44062ef611 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] HTTP exception thrown: Instance 9104e014-d497-460a-8215-6439f0a2e521 could not be found. Jun 15 14:49:56.442958 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-fe698d3f-fee2-41d7-b04e-1f44062ef611 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Request method failure captured: Jun 15 14:49:56.442958 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 HTTP/1.1 Jun 15 14:49:56.442958 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:49:56.442958 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:49:56.442958 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:49:56.442958 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:49:56.442958 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:49:56.442958 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:49:56.442958 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:49:56.442958 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:49:56.442958 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfCm032uWqqc3qLuILnOfrclWfNJ6FPVx3z6BSvdFLc1_kayD56WiDbC6eaDQEVya7DxxzvsZcfxfV1635zr_H1y_QTNvMAtsyBZogQj6qxW6aiFRVRGiOUFYW1vD2u-3grRXuk8o1BP68x5v9gc2IKSZk90rzp7xBUV-Db9UjgjI2c Jun 15 14:49:56.442958 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:49:56.442958 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:49:56.442958 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:49:56.442958 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:49:56.442958 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:49:56.442958 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:49:56.442958 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 2350f7b62a7d4d8199faf8b18b2ca8dc Jun 15 14:49:56.442958 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-TestVolumeBootPattern-1812848035 Jun 15 14:49:56.442958 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:49:56.442958 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:49:56.444457 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2350f7b62a7d4d8199faf8b18b2ca8dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2350f7b62a7d4d8199faf8b18b2ca8dc", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2350f7b62a7d4d8199faf8b18b2ca8dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2350f7b62a7d4d8199faf8b18b2ca8dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:49:56.444457 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-TestVolumeBootPattern-1812848035 Jun 15 14:49:56.444457 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 2350f7b62a7d4d8199faf8b18b2ca8dc Jun 15 14:49:56.444457 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-TestVolumeBootPattern-1812848035 Jun 15 14:49:56.444457 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-TestVolumeBootPattern-1812848035-project Jun 15 14:49:56.444457 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:49:56.444457 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:49:56.444457 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 67d64cad336c44d28c9cf31fc9896854 Jun 15 14:49:56.444457 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-TestVolumeBootPattern-1812848035-project Jun 15 14:49:56.444457 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:49:56.444457 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Instance 9104e014-d497-460a-8215-6439f0a2e521 could not be found. Jun 15 14:49:56.444457 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': '9104e014-d497-460a-8215-6439f0a2e521'} Jun 15 14:49:56.445272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:49:56.445272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:56.445272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:49:56.445272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:49:56.445272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:49:56.445272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:49:56.445272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:49:56.445272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:49:56.445272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:49:56.445272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:49:56.445272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9104e014-d497-460a-8215-6439f0a2e521 could not be found. Jun 15 14:49:56.445272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:49:56.445272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:56.445272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:49:56.445272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:56.445272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:56.445272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:56.445272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:49:56.445272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:49:56.445272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:49:56.446645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:49:56.446645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:49:56.446645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:49:56.446645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:49:56.446645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:49:56.446645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:49:56.446645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:49:56.446645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9104e014-d497-460a-8215-6439f0a2e521 could not be found. Jun 15 14:49:56.446645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:49:56.446645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:56.446645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:49:56.446645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:56.446645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:56.446645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:56.446645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:49:56.446645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:49:56.446645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9104e014-d497-460a-8215-6439f0a2e521 could not be found. Jun 15 14:49:56.446645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:49:56.447940 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-fe698d3f-fee2-41d7-b04e-1f44062ef611 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Returning 404 to user: Instance 9104e014-d497-460a-8215-6439f0a2e521 could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:49:56.447940 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-fe698d3f-fee2-41d7-b04e-1f44062ef611 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 404 len: 111 microversion: 2.1 time: 0.030072 Jun 15 14:49:56.447940 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 409/792] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:56 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:49:56.589975 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6ce37bc9-490d-4ae4-95ae-129644a82ace tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-438097417", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1261933231", "security_groups": [{"name": "tempest-secgroup-smoke-499501397"}], "block_device_mapping_v2": [{"uuid": "f935187d-c64c-4422-a3b3-3f6723a576f3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e7b389d2-b470-4005-95f3-38993d2e4479"}]}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:56.639214 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-046268cc-b2fe-48aa-82d7-c3b8a8a17461 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:56.639764 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-046268cc-b2fe-48aa-82d7-c3b8a8a17461 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:56.645715 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-046268cc-b2fe-48aa-82d7-c3b8a8a17461 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:56.646171 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-046268cc-b2fe-48aa-82d7-c3b8a8a17461 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:56.646931 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-046268cc-b2fe-48aa-82d7-c3b8a8a17461 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:56.647367 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-046268cc-b2fe-48aa-82d7-c3b8a8a17461 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:56.675012 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.objects.instance [None req-046268cc-b2fe-48aa-82d7-c3b8a8a17461 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lazy-loading 'flavor' on Instance uuid 3fdd6732-ba3a-4243-a57f-7e84f8eea531 {{(pid=124219) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:49:56.704451 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.network.neutron [None req-6ce37bc9-490d-4ae4-95ae-129644a82ace tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] validate_networks() for [('e7b389d2-b470-4005-95f3-38993d2e4479', None, None, None, None, None)] {{(pid=124220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:49:56.756798 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-046268cc-b2fe-48aa-82d7-c3b8a8a17461 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "POST /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531/action" status: 202 len: 0 microversion: 2.1 time: 0.121139 Jun 15 14:49:56.760578 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 410/793] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 14:49:56 2022] POST /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 14:49:56.765942 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-63bee754-7310-4cdf-b50c-76155cf9dcc3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:56.766674 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-63bee754-7310-4cdf-b50c-76155cf9dcc3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:56.773187 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-63bee754-7310-4cdf-b50c-76155cf9dcc3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:56.773647 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-63bee754-7310-4cdf-b50c-76155cf9dcc3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:56.774438 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-63bee754-7310-4cdf-b50c-76155cf9dcc3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:56.774883 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-63bee754-7310-4cdf-b50c-76155cf9dcc3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:56.801697 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-63bee754-7310-4cdf-b50c-76155cf9dcc3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Going to try to terminate instance {{(pid=124219) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:49:56.888526 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-63bee754-7310-4cdf-b50c-76155cf9dcc3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "DELETE /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 204 len: 0 microversion: 2.1 time: 0.126293 Jun 15 14:49:56.889112 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 411/794] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:49:56 2022] DELETE /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:49:56.894561 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f6a17c54-d63c-4d34-95d7-73ba941cbe99 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:56.895260 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f6a17c54-d63c-4d34-95d7-73ba941cbe99 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:56.901060 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f6a17c54-d63c-4d34-95d7-73ba941cbe99 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:56.901512 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f6a17c54-d63c-4d34-95d7-73ba941cbe99 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:56.902365 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f6a17c54-d63c-4d34-95d7-73ba941cbe99 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:56.902782 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f6a17c54-d63c-4d34-95d7-73ba941cbe99 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:57.036427 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f6a17c54-d63c-4d34-95d7-73ba941cbe99 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:57.044442 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f6a17c54-d63c-4d34-95d7-73ba941cbe99 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1566 microversion: 2.1 time: 0.153732 Jun 15 14:49:57.053807 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 412/795] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:56 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:57.053807 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-4db626e3-d6e0-46d9-a7c0-2f44653fc012 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:57.053807 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-4db626e3-d6e0-46d9-a7c0-2f44653fc012 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:57.057653 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4db626e3-d6e0-46d9-a7c0-2f44653fc012 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:57.058206 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4db626e3-d6e0-46d9-a7c0-2f44653fc012 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:57.059041 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4db626e3-d6e0-46d9-a7c0-2f44653fc012 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:57.059551 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4db626e3-d6e0-46d9-a7c0-2f44653fc012 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:57.099090 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-6ce37bc9-490d-4ae4-95ae-129644a82ace tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Flavor limits 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:49:57.099524 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-6ce37bc9-490d-4ae4-95ae-129644a82ace tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Image limits 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:49:57.099996 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-6ce37bc9-490d-4ae4-95ae-129644a82ace tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Flavor pref 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:49:57.100455 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-6ce37bc9-490d-4ae4-95ae-129644a82ace tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Image pref 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:49:57.101044 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-6ce37bc9-490d-4ae4-95ae-129644a82ace tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:49:57.110149 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6ce37bc9-490d-4ae4-95ae-129644a82ace tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:57.110606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6ce37bc9-490d-4ae4-95ae-129644a82ace tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:57.111406 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6ce37bc9-490d-4ae4-95ae-129644a82ace tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:57.111838 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6ce37bc9-490d-4ae4-95ae-129644a82ace tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:57.129826 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-6ce37bc9-490d-4ae4-95ae-129644a82ace tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Getting quotas for project 2350f7b62a7d4d8199faf8b18b2ca8dc. Resources: {'cores', 'instances', 'ram'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:49:57.133808 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-6ce37bc9-490d-4ae4-95ae-129644a82ace tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Getting quotas for user 67d64cad336c44d28c9cf31fc9896854 and project 2350f7b62a7d4d8199faf8b18b2ca8dc. Resources: {'cores', 'instances', 'ram'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:49:57.193352 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6ce37bc9-490d-4ae4-95ae-129644a82ace tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Going to run 1 instances... {{(pid=124220) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:49:57.195567 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6ce37bc9-490d-4ae4-95ae-129644a82ace tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f935187d-c64c-4422-a3b3-3f6723a576f3',volume_size=None,volume_type=None)] {{(pid=124220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:49:57.206495 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-4db626e3-d6e0-46d9-a7c0-2f44653fc012 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:57.214654 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-4db626e3-d6e0-46d9-a7c0-2f44653fc012 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:57.216164 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-4db626e3-d6e0-46d9-a7c0-2f44653fc012 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:57.217323 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-4db626e3-d6e0-46d9-a7c0-2f44653fc012 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1720 microversion: 2.20 time: 0.171605 Jun 15 14:49:57.218610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 413/796] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:57 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:57.224317 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c72b56fd-5889-4df5-b024-da5baf11c414 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:57.225170 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c72b56fd-5889-4df5-b024-da5baf11c414 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:57.231348 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c72b56fd-5889-4df5-b024-da5baf11c414 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:57.231800 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c72b56fd-5889-4df5-b024-da5baf11c414 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:57.232659 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c72b56fd-5889-4df5-b024-da5baf11c414 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:57.233070 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c72b56fd-5889-4df5-b024-da5baf11c414 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:57.332128 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-6ce37bc9-490d-4ae4-95ae-129644a82ace tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.746007 Jun 15 14:49:57.333005 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 384/797] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 14:49:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:49:57.343443 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-3f0cdd6f-af7c-41a9-bcf2-0a96b803837f tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:57.343672 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-3f0cdd6f-af7c-41a9-bcf2-0a96b803837f tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:57.379818 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c72b56fd-5889-4df5-b024-da5baf11c414 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:57.387437 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-c72b56fd-5889-4df5-b024-da5baf11c414 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1506 microversion: 2.1 time: 0.167871 Jun 15 14:49:57.397817 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 414/798] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:57 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:57.400661 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-3f0cdd6f-af7c-41a9-bcf2-0a96b803837f tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:57.407922 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-3f0cdd6f-af7c-41a9-bcf2-0a96b803837f tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 200 len: 1094 microversion: 2.1 time: 0.069213 Jun 15 14:49:57.408492 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 385/799] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:57 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:49:58.062758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-fba7ab87-1f8c-4129-9405-47b79a83e669 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:58.063375 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-fba7ab87-1f8c-4129-9405-47b79a83e669 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:58.069840 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fba7ab87-1f8c-4129-9405-47b79a83e669 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:58.070295 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fba7ab87-1f8c-4129-9405-47b79a83e669 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:58.071061 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fba7ab87-1f8c-4129-9405-47b79a83e669 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:58.071501 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fba7ab87-1f8c-4129-9405-47b79a83e669 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:58.200641 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-fba7ab87-1f8c-4129-9405-47b79a83e669 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:58.208416 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-fba7ab87-1f8c-4129-9405-47b79a83e669 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1566 microversion: 2.1 time: 0.150312 Jun 15 14:49:58.208974 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 415/800] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:58 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:58.237406 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-e8b44b87-1366-4991-bff2-9073b2c61fcc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:58.238057 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-e8b44b87-1366-4991-bff2-9073b2c61fcc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:58.244459 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e8b44b87-1366-4991-bff2-9073b2c61fcc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:58.244904 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e8b44b87-1366-4991-bff2-9073b2c61fcc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:58.245652 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e8b44b87-1366-4991-bff2-9073b2c61fcc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:58.246105 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e8b44b87-1366-4991-bff2-9073b2c61fcc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:58.379380 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e8b44b87-1366-4991-bff2-9073b2c61fcc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:58.387326 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e8b44b87-1366-4991-bff2-9073b2c61fcc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:58.388840 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e8b44b87-1366-4991-bff2-9073b2c61fcc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:58.390027 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-e8b44b87-1366-4991-bff2-9073b2c61fcc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1720 microversion: 2.20 time: 0.157638 Jun 15 14:49:58.390590 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 386/801] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:58 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:58.404704 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f2f1ed4b-62cd-4b05-a084-5bccd0e64db0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:58.405956 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f2f1ed4b-62cd-4b05-a084-5bccd0e64db0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:58.412108 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f2f1ed4b-62cd-4b05-a084-5bccd0e64db0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:58.412635 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f2f1ed4b-62cd-4b05-a084-5bccd0e64db0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:58.413397 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f2f1ed4b-62cd-4b05-a084-5bccd0e64db0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:58.413860 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f2f1ed4b-62cd-4b05-a084-5bccd0e64db0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:58.424863 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-e5642385-8558-46ef-8090-8352055eca70 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:58.425480 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-e5642385-8558-46ef-8090-8352055eca70 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:58.431482 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e5642385-8558-46ef-8090-8352055eca70 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:58.432484 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e5642385-8558-46ef-8090-8352055eca70 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:58.432706 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e5642385-8558-46ef-8090-8352055eca70 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:58.433146 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e5642385-8558-46ef-8090-8352055eca70 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:58.494078 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e5642385-8558-46ef-8090-8352055eca70 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:58.501727 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-e5642385-8558-46ef-8090-8352055eca70 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 200 len: 1144 microversion: 2.1 time: 0.081234 Jun 15 14:49:58.502341 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 387/802] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:58 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:49:58.548202 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f2f1ed4b-62cd-4b05-a084-5bccd0e64db0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:58.555631 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f2f1ed4b-62cd-4b05-a084-5bccd0e64db0 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1506 microversion: 2.1 time: 0.154773 Jun 15 14:49:58.556180 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 416/803] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:58 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:59.225542 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-8890d64e-5d30-48da-8aaa-d42354487c4e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:59.226203 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-8890d64e-5d30-48da-8aaa-d42354487c4e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:59.232045 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8890d64e-5d30-48da-8aaa-d42354487c4e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:59.232488 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8890d64e-5d30-48da-8aaa-d42354487c4e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:59.233290 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8890d64e-5d30-48da-8aaa-d42354487c4e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:59.233748 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8890d64e-5d30-48da-8aaa-d42354487c4e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:59.368728 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-8890d64e-5d30-48da-8aaa-d42354487c4e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:59.377553 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-8890d64e-5d30-48da-8aaa-d42354487c4e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1566 microversion: 2.1 time: 0.156023 Jun 15 14:49:59.378182 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 388/804] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:59 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:59.408853 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-4f9ac782-5f18-4ea2-91de-5d43bc261f82 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:59.409886 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-4f9ac782-5f18-4ea2-91de-5d43bc261f82 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:59.416297 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4f9ac782-5f18-4ea2-91de-5d43bc261f82 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:59.416740 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4f9ac782-5f18-4ea2-91de-5d43bc261f82 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:59.417496 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4f9ac782-5f18-4ea2-91de-5d43bc261f82 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:59.417954 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4f9ac782-5f18-4ea2-91de-5d43bc261f82 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:59.518550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-821acf93-b57f-42aa-8ac5-f2051dcc1876 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:59.519505 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-821acf93-b57f-42aa-8ac5-f2051dcc1876 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:59.525547 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-821acf93-b57f-42aa-8ac5-f2051dcc1876 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:59.526043 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-821acf93-b57f-42aa-8ac5-f2051dcc1876 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:59.526909 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-821acf93-b57f-42aa-8ac5-f2051dcc1876 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:59.527349 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-821acf93-b57f-42aa-8ac5-f2051dcc1876 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:59.550710 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-4f9ac782-5f18-4ea2-91de-5d43bc261f82 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:59.558875 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-4f9ac782-5f18-4ea2-91de-5d43bc261f82 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:59.560384 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-4f9ac782-5f18-4ea2-91de-5d43bc261f82 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:59.562116 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-4f9ac782-5f18-4ea2-91de-5d43bc261f82 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1720 microversion: 2.20 time: 0.157192 Jun 15 14:49:59.562743 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 417/805] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:49:59 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:59.571923 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c4f77c4f-f43d-4bbd-bc23-9619a087291c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:59.572680 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c4f77c4f-f43d-4bbd-bc23-9619a087291c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:49:59.579172 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c4f77c4f-f43d-4bbd-bc23-9619a087291c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:59.579629 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c4f77c4f-f43d-4bbd-bc23-9619a087291c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:59.580398 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c4f77c4f-f43d-4bbd-bc23-9619a087291c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:59.580837 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c4f77c4f-f43d-4bbd-bc23-9619a087291c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:59.591759 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-821acf93-b57f-42aa-8ac5-f2051dcc1876 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:59.600870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-821acf93-b57f-42aa-8ac5-f2051dcc1876 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 200 len: 1192 microversion: 2.1 time: 0.086242 Jun 15 14:49:59.601455 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 389/806] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:59 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:49:59.709621 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c4f77c4f-f43d-4bbd-bc23-9619a087291c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:49:59.717035 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-c4f77c4f-f43d-4bbd-bc23-9619a087291c tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1506 microversion: 2.1 time: 0.148769 Jun 15 14:49:59.718167 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 418/807] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:49:59 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:00.398795 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-f677a2d9-19a3-4382-9126-b24f3f8239be tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:00.399960 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-f677a2d9-19a3-4382-9126-b24f3f8239be tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:00.407787 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f677a2d9-19a3-4382-9126-b24f3f8239be tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:00.408529 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f677a2d9-19a3-4382-9126-b24f3f8239be tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:00.409319 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f677a2d9-19a3-4382-9126-b24f3f8239be tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:00.410198 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f677a2d9-19a3-4382-9126-b24f3f8239be tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:00.518249 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-395aed08-3c51-4c6c-bb04-c4bd3742e647 req-085286c4-e632-46e2-b004-a7472a485844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373c3c82-91e0-4d91-8933-c2dbe3582fee", "name": "network-vif-deleted", "tag": "ddfa8e08-5c5d-4799-9986-83a3e2b1e12e"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:00.543502 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-395aed08-3c51-4c6c-bb04-c4bd3742e647 req-085286c4-e632-46e2-b004-a7472a485844 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:00.545034 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-395aed08-3c51-4c6c-bb04-c4bd3742e647 req-085286c4-e632-46e2-b004-a7472a485844 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:00.561184 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-395aed08-3c51-4c6c-bb04-c4bd3742e647 req-085286c4-e632-46e2-b004-a7472a485844 service nova] Creating event network-vif-deleted:ddfa8e08-5c5d-4799-9986-83a3e2b1e12e for instance 373c3c82-91e0-4d91-8933-c2dbe3582fee on hv-cinder-84327 Jun 15 14:50:00.571082 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-395aed08-3c51-4c6c-bb04-c4bd3742e647 req-085286c4-e632-46e2-b004-a7472a485844 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057123 Jun 15 14:50:00.572291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 419/808] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:00.587076 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-71bc9141-1395-463e-9930-bb60e0ea899f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:00.588785 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-71bc9141-1395-463e-9930-bb60e0ea899f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:00.605003 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-71bc9141-1395-463e-9930-bb60e0ea899f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:00.607309 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-71bc9141-1395-463e-9930-bb60e0ea899f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:00.612565 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-71bc9141-1395-463e-9930-bb60e0ea899f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:00.613898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-71bc9141-1395-463e-9930-bb60e0ea899f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:00.711933 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-f677a2d9-19a3-4382-9126-b24f3f8239be tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:00.721032 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-f677a2d9-19a3-4382-9126-b24f3f8239be tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1566 microversion: 2.1 time: 0.329328 Jun 15 14:50:00.721933 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 390/809] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:00 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1566 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:00.727244 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-73493fa0-71dc-4565-8757-6d34c342171e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:00.728201 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-73493fa0-71dc-4565-8757-6d34c342171e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:00.737093 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-73493fa0-71dc-4565-8757-6d34c342171e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:00.737765 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-73493fa0-71dc-4565-8757-6d34c342171e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:00.739019 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-73493fa0-71dc-4565-8757-6d34c342171e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:00.739619 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-73493fa0-71dc-4565-8757-6d34c342171e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:00.842433 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-73493fa0-71dc-4565-8757-6d34c342171e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:00.850427 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-71bc9141-1395-463e-9930-bb60e0ea899f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:00.859846 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-73493fa0-71dc-4565-8757-6d34c342171e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 200 len: 1210 microversion: 2.1 time: 0.136675 Jun 15 14:50:00.860105 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-71bc9141-1395-463e-9930-bb60e0ea899f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:00.860864 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 391/810] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:00 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 1210 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:00.864000 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-71bc9141-1395-463e-9930-bb60e0ea899f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:00.866152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-419ac522-32ca-436c-b3d9-93328369c55f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:00.866320 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-71bc9141-1395-463e-9930-bb60e0ea899f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1720 microversion: 2.20 time: 0.289311 Jun 15 14:50:00.867096 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-419ac522-32ca-436c-b3d9-93328369c55f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:00.874065 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-419ac522-32ca-436c-b3d9-93328369c55f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:00.875609 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-419ac522-32ca-436c-b3d9-93328369c55f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:00.876599 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-419ac522-32ca-436c-b3d9-93328369c55f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:00.877206 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-419ac522-32ca-436c-b3d9-93328369c55f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:00.878391 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 420/811] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:00 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1720 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:50:00.913904 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-419ac522-32ca-436c-b3d9-93328369c55f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:00.914634 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-419ac522-32ca-436c-b3d9-93328369c55f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:00.915102 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.objects.instance [None req-419ac522-32ca-436c-b3d9-93328369c55f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lazy-loading 'fault' on Instance uuid 373c3c82-91e0-4d91-8933-c2dbe3582fee {{(pid=124220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:50:01.158775 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-419ac522-32ca-436c-b3d9-93328369c55f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:01.167043 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-419ac522-32ca-436c-b3d9-93328369c55f tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 200 len: 1311 microversion: 2.1 time: 0.304836 Jun 15 14:50:01.167623 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 392/812] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:00 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 1311 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:01.739280 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-72e9a6c2-04f6-44eb-893e-952bd96dd80e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:01.739945 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-72e9a6c2-04f6-44eb-893e-952bd96dd80e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:01.746742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-72e9a6c2-04f6-44eb-893e-952bd96dd80e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:01.747205 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-72e9a6c2-04f6-44eb-893e-952bd96dd80e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:01.747986 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-72e9a6c2-04f6-44eb-893e-952bd96dd80e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:01.748430 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-72e9a6c2-04f6-44eb-893e-952bd96dd80e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:01.767274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:01.879194 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-220cae2c-5125-45f6-969a-6ff1e23d31c5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:01.880591 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-220cae2c-5125-45f6-969a-6ff1e23d31c5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:01.887772 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-220cae2c-5125-45f6-969a-6ff1e23d31c5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:01.888550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-220cae2c-5125-45f6-969a-6ff1e23d31c5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:01.890104 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-220cae2c-5125-45f6-969a-6ff1e23d31c5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:01.890962 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-220cae2c-5125-45f6-969a-6ff1e23d31c5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:01.893303 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-72e9a6c2-04f6-44eb-893e-952bd96dd80e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:01.903327 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-72e9a6c2-04f6-44eb-893e-952bd96dd80e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1566 microversion: 2.1 time: 0.167828 Jun 15 14:50:01.903916 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 421/813] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:01 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:01.908824 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-8acc82d3-0d9d-4f4f-8c39-3718ab127ff4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:01.909436 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-8acc82d3-0d9d-4f4f-8c39-3718ab127ff4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:01.915758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8acc82d3-0d9d-4f4f-8c39-3718ab127ff4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:01.916215 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8acc82d3-0d9d-4f4f-8c39-3718ab127ff4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:01.916995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8acc82d3-0d9d-4f4f-8c39-3718ab127ff4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:01.917441 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8acc82d3-0d9d-4f4f-8c39-3718ab127ff4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:02.100512 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-220cae2c-5125-45f6-969a-6ff1e23d31c5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:02.109406 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-220cae2c-5125-45f6-969a-6ff1e23d31c5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 200 len: 1265 microversion: 2.1 time: 0.234941 Jun 15 14:50:02.112163 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 393/814] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:01 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:02.185768 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c235b542-cbe7-4e45-894d-bbb7343b0e02 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:02.187747 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-c235b542-cbe7-4e45-894d-bbb7343b0e02 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 373c3c82-91e0-4d91-8933-c2dbe3582fee] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:02.197180 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c235b542-cbe7-4e45-894d-bbb7343b0e02 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:02.198021 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c235b542-cbe7-4e45-894d-bbb7343b0e02 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:02.199031 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c235b542-cbe7-4e45-894d-bbb7343b0e02 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:02.199850 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c235b542-cbe7-4e45-894d-bbb7343b0e02 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:02.219869 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.wsgi [None req-c235b542-cbe7-4e45-894d-bbb7343b0e02 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] HTTP exception thrown: Instance 373c3c82-91e0-4d91-8933-c2dbe3582fee could not be found. Jun 15 14:50:02.222250 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c235b542-cbe7-4e45-894d-bbb7343b0e02 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Request method failure captured: Jun 15 14:50:02.222250 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: request: GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee HTTP/1.1 Jun 15 14:50:02.222250 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept: application/json Jun 15 14:50:02.222250 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept-Encoding: identity Jun 15 14:50:02.222250 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Connection: close Jun 15 14:50:02.222250 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Length: 0 Jun 15 14:50:02.222250 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Type: application/json Jun 15 14:50:02.222250 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Host: 10.222.0.57 Jun 15 14:50:02.222250 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Openstack-System-Scope: None Jun 15 14:50:02.222250 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: User-Agent: python-urllib3/1.26.9 Jun 15 14:50:02.222250 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Auth-Token: gAAAAABiqfAJ8wPnkqs_k4Bo8GSWGVuB1Ap-R1u4L7mH2U3HEuvWVNvlRBO_qyAD7QzOZMMEzF_zcaK0X4c1eXso_54pW74XDCCkghDRm0zR7H0M-gVJaO4FWuw9AQkWNKuoAF0zQpil6wRuiB3fOyyvDJwL5UyfZxFCESuQo14vuw2L05AA968 Jun 15 14:50:02.222250 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Id: None Jun 15 14:50:02.222250 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Name: None Jun 15 14:50:02.222250 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Identity-Status: Confirmed Jun 15 14:50:02.222250 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Is-Admin-Project: True Jun 15 14:50:02.222250 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Id: default Jun 15 14:50:02.222250 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Name: Default Jun 15 14:50:02.222250 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Id: 26d36b3b04f046d3bee421c5987b965b Jun 15 14:50:02.222250 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1197112882 Jun 15 14:50:02.222250 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Role: member,reader Jun 15 14:50:02.222250 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Roles: member,reader Jun 15 14:50:02.224033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/26d36b3b04f046d3bee421c5987b965b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_26d36b3b04f046d3bee421c5987b965b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/26d36b3b04f046d3bee421c5987b965b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/26d36b3b04f046d3bee421c5987b965b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:50:02.224033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1197112882 Jun 15 14:50:02.224033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Id: 26d36b3b04f046d3bee421c5987b965b Jun 15 14:50:02.224033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1197112882 Jun 15 14:50:02.224033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User: tempest-ServerRescueNegativeTestJSON-1197112882-project Jun 15 14:50:02.224033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Id: default Jun 15 14:50:02.224033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Name: Default Jun 15 14:50:02.224033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Id: ed7372fed3e14f3e98ca25d22a7c7a7e Jun 15 14:50:02.224033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1197112882-project Jun 15 14:50:02.224033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: method: > Jun 15 14:50:02.224033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: exception: Instance 373c3c82-91e0-4d91-8933-c2dbe3582fee could not be found. Jun 15 14:50:02.224033 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: action_args: {'id': '373c3c82-91e0-4d91-8933-c2dbe3582fee'} Jun 15 14:50:02.224820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:50:02.224820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:50:02.224820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:50:02.224820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:50:02.224820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:50:02.224820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:50:02.224820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:50:02.224820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:50:02.224820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:50:02.224820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:50:02.224820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 373c3c82-91e0-4d91-8933-c2dbe3582fee could not be found. Jun 15 14:50:02.224820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:50:02.224820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:50:02.224820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:50:02.224820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:50:02.224820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:50:02.224820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:50:02.224820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:50:02.224820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:50:02.224820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:50:02.226119 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:50:02.226119 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:50:02.226119 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:50:02.226119 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:50:02.226119 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:50:02.226119 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:50:02.226119 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:50:02.226119 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 373c3c82-91e0-4d91-8933-c2dbe3582fee could not be found. Jun 15 14:50:02.226119 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:50:02.226119 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:50:02.226119 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:50:02.226119 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:50:02.226119 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:50:02.226119 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:50:02.226119 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:50:02.226119 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:50:02.226119 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 373c3c82-91e0-4d91-8933-c2dbe3582fee could not be found. Jun 15 14:50:02.226119 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:50:02.227215 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c235b542-cbe7-4e45-894d-bbb7343b0e02 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Returning 404 to user: Instance 373c3c82-91e0-4d91-8933-c2dbe3582fee could not be found. {{(pid=124220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:50:02.227215 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-c235b542-cbe7-4e45-894d-bbb7343b0e02 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee" status: 404 len: 111 microversion: 2.1 time: 0.042775 Jun 15 14:50:02.227215 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 394/815] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:02 2022] GET /compute/v2.1/servers/373c3c82-91e0-4d91-8933-c2dbe3582fee => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 14:50:02.230567 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-3cdaa05b-7baa-487b-92fb-822cfbb3a15c req-e157bfb1-3a2f-40ca-980c-6b8ae19bb9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef2057b-c064-4900-a338-f86a4383746f", "tag": "a2b93273-5f17-40f1-81a6-00e33227d97a"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:02.239996 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-3cdaa05b-7baa-487b-92fb-822cfbb3a15c req-e157bfb1-3a2f-40ca-980c-6b8ae19bb9b9 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:02.240588 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-3cdaa05b-7baa-487b-92fb-822cfbb3a15c req-e157bfb1-3a2f-40ca-980c-6b8ae19bb9b9 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:02.270630 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-3cdaa05b-7baa-487b-92fb-822cfbb3a15c req-e157bfb1-3a2f-40ca-980c-6b8ae19bb9b9 service nova] Creating event network-changed:a2b93273-5f17-40f1-81a6-00e33227d97a for instance 6ef2057b-c064-4900-a338-f86a4383746f on hv-cinder-84327 Jun 15 14:50:02.277820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-3cdaa05b-7baa-487b-92fb-822cfbb3a15c req-e157bfb1-3a2f-40ca-980c-6b8ae19bb9b9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051831 Jun 15 14:50:02.278603 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 395/816] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:02.287262 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1a013a7c-7e3e-45fd-a23b-2e9b09008e03 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:02.287898 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1a013a7c-7e3e-45fd-a23b-2e9b09008e03 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:02.295059 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1a013a7c-7e3e-45fd-a23b-2e9b09008e03 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:02.295518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1a013a7c-7e3e-45fd-a23b-2e9b09008e03 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:02.296310 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1a013a7c-7e3e-45fd-a23b-2e9b09008e03 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:02.296756 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1a013a7c-7e3e-45fd-a23b-2e9b09008e03 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:02.324626 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1a013a7c-7e3e-45fd-a23b-2e9b09008e03 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Going to try to terminate instance {{(pid=124220) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:50:02.350704 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-8acc82d3-0d9d-4f4f-8c39-3718ab127ff4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:02.360207 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-8acc82d3-0d9d-4f4f-8c39-3718ab127ff4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:02.362198 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-8acc82d3-0d9d-4f4f-8c39-3718ab127ff4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:02.363670 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-8acc82d3-0d9d-4f4f-8c39-3718ab127ff4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1720 microversion: 2.20 time: 0.458830 Jun 15 14:50:02.375671 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 422/817] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:01 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1720 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:02.427788 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-1a013a7c-7e3e-45fd-a23b-2e9b09008e03 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "DELETE /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 204 len: 0 microversion: 2.1 time: 0.146356 Jun 15 14:50:02.428108 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 396/818] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:50:02 2022] DELETE /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:50:02.436070 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-257d6386-b132-49b8-aca8-db04af73d23b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:02.437134 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-257d6386-b132-49b8-aca8-db04af73d23b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:02.443637 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-257d6386-b132-49b8-aca8-db04af73d23b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:02.444341 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-257d6386-b132-49b8-aca8-db04af73d23b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:02.445125 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-257d6386-b132-49b8-aca8-db04af73d23b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:02.445565 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-257d6386-b132-49b8-aca8-db04af73d23b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:02.578491 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-257d6386-b132-49b8-aca8-db04af73d23b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:02.585948 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-257d6386-b132-49b8-aca8-db04af73d23b tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.153867 Jun 15 14:50:02.586510 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 423/819] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:02 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:02.922035 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-ad58b55e-9cb7-4d01-8626-dde2381aa234 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:02.922737 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-ad58b55e-9cb7-4d01-8626-dde2381aa234 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:02.929169 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ad58b55e-9cb7-4d01-8626-dde2381aa234 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:02.929620 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ad58b55e-9cb7-4d01-8626-dde2381aa234 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:02.930414 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ad58b55e-9cb7-4d01-8626-dde2381aa234 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:02.930849 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ad58b55e-9cb7-4d01-8626-dde2381aa234 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:02.945953 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:03.066204 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ad58b55e-9cb7-4d01-8626-dde2381aa234 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:03.073630 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-ad58b55e-9cb7-4d01-8626-dde2381aa234 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1566 microversion: 2.1 time: 0.155841 Jun 15 14:50:03.074214 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 397/820] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:02 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:03.128702 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-2d3dfc8a-91f5-4c06-9667-bf2d05344a7f tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:03.129325 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-2d3dfc8a-91f5-4c06-9667-bf2d05344a7f tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:03.135473 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2d3dfc8a-91f5-4c06-9667-bf2d05344a7f tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:03.135924 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2d3dfc8a-91f5-4c06-9667-bf2d05344a7f tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:03.136681 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2d3dfc8a-91f5-4c06-9667-bf2d05344a7f tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:03.137115 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2d3dfc8a-91f5-4c06-9667-bf2d05344a7f tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:03.271971 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-2d3dfc8a-91f5-4c06-9667-bf2d05344a7f tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:03.280902 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-2d3dfc8a-91f5-4c06-9667-bf2d05344a7f tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 200 len: 1265 microversion: 2.1 time: 0.156037 Jun 15 14:50:03.281484 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 424/821] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:03 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:03.382819 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-5e46330d-158d-4289-9540-7721e81d0a9c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:03.383430 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-5e46330d-158d-4289-9540-7721e81d0a9c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:03.389987 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5e46330d-158d-4289-9540-7721e81d0a9c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:03.390687 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5e46330d-158d-4289-9540-7721e81d0a9c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:03.391473 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5e46330d-158d-4289-9540-7721e81d0a9c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:03.391909 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5e46330d-158d-4289-9540-7721e81d0a9c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:03.519067 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-5e46330d-158d-4289-9540-7721e81d0a9c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:03.526868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-5e46330d-158d-4289-9540-7721e81d0a9c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:03.528351 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-5e46330d-158d-4289-9540-7721e81d0a9c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:03.529495 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-5e46330d-158d-4289-9540-7721e81d0a9c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1720 microversion: 2.20 time: 0.150680 Jun 15 14:50:03.530098 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 398/822] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:03 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:03.603480 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-9c7f5cbe-8cda-409e-887b-31896e188d7d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:03.604094 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-9c7f5cbe-8cda-409e-887b-31896e188d7d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:03.610179 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9c7f5cbe-8cda-409e-887b-31896e188d7d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:03.610631 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9c7f5cbe-8cda-409e-887b-31896e188d7d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:03.611389 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9c7f5cbe-8cda-409e-887b-31896e188d7d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:03.611830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9c7f5cbe-8cda-409e-887b-31896e188d7d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:03.888558 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-9c7f5cbe-8cda-409e-887b-31896e188d7d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:03.896127 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-9c7f5cbe-8cda-409e-887b-31896e188d7d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.296502 Jun 15 14:50:03.896677 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 425/823] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:03 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:04.090848 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6eba80fa-6959-4a92-8d0e-1ddee4c92b12 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:04.091371 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6eba80fa-6959-4a92-8d0e-1ddee4c92b12 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:04.097992 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6eba80fa-6959-4a92-8d0e-1ddee4c92b12 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:04.098698 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6eba80fa-6959-4a92-8d0e-1ddee4c92b12 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:04.099455 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6eba80fa-6959-4a92-8d0e-1ddee4c92b12 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:04.099891 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6eba80fa-6959-4a92-8d0e-1ddee4c92b12 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:04.231136 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6eba80fa-6959-4a92-8d0e-1ddee4c92b12 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:04.239720 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-6eba80fa-6959-4a92-8d0e-1ddee4c92b12 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1566 microversion: 2.1 time: 0.152775 Jun 15 14:50:04.240284 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 399/824] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:04 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:04.297018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0dd3b3d3-9f3b-4a56-9f15-a59b37b276de tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:04.297679 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-0dd3b3d3-9f3b-4a56-9f15-a59b37b276de tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:04.304349 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0dd3b3d3-9f3b-4a56-9f15-a59b37b276de tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:04.304798 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0dd3b3d3-9f3b-4a56-9f15-a59b37b276de tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:04.305560 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0dd3b3d3-9f3b-4a56-9f15-a59b37b276de tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:04.306025 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0dd3b3d3-9f3b-4a56-9f15-a59b37b276de tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:04.437876 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0dd3b3d3-9f3b-4a56-9f15-a59b37b276de tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:04.445364 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-0dd3b3d3-9f3b-4a56-9f15-a59b37b276de tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 200 len: 1265 microversion: 2.1 time: 0.152312 Jun 15 14:50:04.445967 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 426/825] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:04 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:04.546681 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-0ba8f772-3672-42b0-9a1f-acfb2db6801c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:04.547293 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-0ba8f772-3672-42b0-9a1f-acfb2db6801c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:04.553338 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0ba8f772-3672-42b0-9a1f-acfb2db6801c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:04.553833 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0ba8f772-3672-42b0-9a1f-acfb2db6801c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:04.554595 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0ba8f772-3672-42b0-9a1f-acfb2db6801c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:04.555036 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0ba8f772-3672-42b0-9a1f-acfb2db6801c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:04.687827 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-0ba8f772-3672-42b0-9a1f-acfb2db6801c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:04.696182 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-0ba8f772-3672-42b0-9a1f-acfb2db6801c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:04.697676 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-0ba8f772-3672-42b0-9a1f-acfb2db6801c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:04.698844 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-0ba8f772-3672-42b0-9a1f-acfb2db6801c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1720 microversion: 2.20 time: 0.156197 Jun 15 14:50:04.699403 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 400/826] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:04 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:04.912812 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-7e63a1f0-f4fe-42f8-8a08-2d57167537e3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:04.913356 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-7e63a1f0-f4fe-42f8-8a08-2d57167537e3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:04.919363 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7e63a1f0-f4fe-42f8-8a08-2d57167537e3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:04.919810 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7e63a1f0-f4fe-42f8-8a08-2d57167537e3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:04.920556 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7e63a1f0-f4fe-42f8-8a08-2d57167537e3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:04.921025 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7e63a1f0-f4fe-42f8-8a08-2d57167537e3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:05.047762 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-7e63a1f0-f4fe-42f8-8a08-2d57167537e3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:05.055128 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-7e63a1f0-f4fe-42f8-8a08-2d57167537e3 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.146183 Jun 15 14:50:05.055670 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 427/827] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:04 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:05.256512 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-020246cb-b903-45ef-b5e7-f7840c215b86 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:05.257058 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-020246cb-b903-45ef-b5e7-f7840c215b86 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:05.263724 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-020246cb-b903-45ef-b5e7-f7840c215b86 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:05.264180 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-020246cb-b903-45ef-b5e7-f7840c215b86 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:05.265740 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-020246cb-b903-45ef-b5e7-f7840c215b86 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:05.266197 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-020246cb-b903-45ef-b5e7-f7840c215b86 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:05.429579 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-020246cb-b903-45ef-b5e7-f7840c215b86 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:05.437773 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-020246cb-b903-45ef-b5e7-f7840c215b86 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1566 microversion: 2.1 time: 0.185040 Jun 15 14:50:05.440721 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 401/828] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:05 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1566 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:05.462510 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-aca9ae66-78a1-4e86-8777-d6ebce360ba0 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:05.463120 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-aca9ae66-78a1-4e86-8777-d6ebce360ba0 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:05.469894 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-aca9ae66-78a1-4e86-8777-d6ebce360ba0 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:05.470345 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-aca9ae66-78a1-4e86-8777-d6ebce360ba0 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:05.471110 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-aca9ae66-78a1-4e86-8777-d6ebce360ba0 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:05.471543 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-aca9ae66-78a1-4e86-8777-d6ebce360ba0 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:05.601105 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-aca9ae66-78a1-4e86-8777-d6ebce360ba0 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:05.608961 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-aca9ae66-78a1-4e86-8777-d6ebce360ba0 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 200 len: 1265 microversion: 2.1 time: 0.149724 Jun 15 14:50:05.609513 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 428/829] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:05 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:05.718383 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-e9d7e1d1-46fc-495c-9034-f2f68bced552 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:05.719081 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-e9d7e1d1-46fc-495c-9034-f2f68bced552 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:05.725322 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e9d7e1d1-46fc-495c-9034-f2f68bced552 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:05.725800 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e9d7e1d1-46fc-495c-9034-f2f68bced552 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:05.726577 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e9d7e1d1-46fc-495c-9034-f2f68bced552 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:05.727008 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e9d7e1d1-46fc-495c-9034-f2f68bced552 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:05.883666 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e9d7e1d1-46fc-495c-9034-f2f68bced552 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:05.892131 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e9d7e1d1-46fc-495c-9034-f2f68bced552 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:05.893618 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e9d7e1d1-46fc-495c-9034-f2f68bced552 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:05.894797 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-e9d7e1d1-46fc-495c-9034-f2f68bced552 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1720 microversion: 2.20 time: 0.181118 Jun 15 14:50:05.895347 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 402/830] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:05 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:06.072354 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-907cf24e-3672-49cb-aeac-c57301f76e9d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:06.072969 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-907cf24e-3672-49cb-aeac-c57301f76e9d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:06.079589 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-907cf24e-3672-49cb-aeac-c57301f76e9d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:06.079968 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-907cf24e-3672-49cb-aeac-c57301f76e9d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:06.080737 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-907cf24e-3672-49cb-aeac-c57301f76e9d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:06.081235 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-907cf24e-3672-49cb-aeac-c57301f76e9d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:06.297906 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-907cf24e-3672-49cb-aeac-c57301f76e9d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:06.307187 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-907cf24e-3672-49cb-aeac-c57301f76e9d tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1520 microversion: 2.1 time: 0.238572 Jun 15 14:50:06.308564 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 429/831] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:06 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:06.455571 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-cd6b9e96-eed5-4733-8366-8e1a2735f748 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:06.456217 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-cd6b9e96-eed5-4733-8366-8e1a2735f748 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:06.462721 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cd6b9e96-eed5-4733-8366-8e1a2735f748 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:06.463176 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cd6b9e96-eed5-4733-8366-8e1a2735f748 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:06.463944 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cd6b9e96-eed5-4733-8366-8e1a2735f748 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:06.464381 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cd6b9e96-eed5-4733-8366-8e1a2735f748 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:06.605928 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-cd6b9e96-eed5-4733-8366-8e1a2735f748 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:06.619367 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-cd6b9e96-eed5-4733-8366-8e1a2735f748 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1566 microversion: 2.1 time: 0.168342 Jun 15 14:50:06.630040 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-68fd1c9c-060a-4ecd-989b-bcd11f9afd7a tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:06.630040 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-68fd1c9c-060a-4ecd-989b-bcd11f9afd7a tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:06.631096 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 403/832] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:06 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:06.635213 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-68fd1c9c-060a-4ecd-989b-bcd11f9afd7a tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:06.635665 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-68fd1c9c-060a-4ecd-989b-bcd11f9afd7a tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:06.636434 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-68fd1c9c-060a-4ecd-989b-bcd11f9afd7a tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:06.637000 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-68fd1c9c-060a-4ecd-989b-bcd11f9afd7a tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:06.655773 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-7f45e98c-1379-4bf7-a691-7fa9f200986f req-bdfa323f-89d3-4ef0-bf2a-d8c907a7107a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24657b06-5ef6-429a-bce1-db0da36fea71", "name": "network-vif-deleted", "tag": "31dbb14f-e111-495f-87c5-4ba2c1afb4a7"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:06.663921 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-7f45e98c-1379-4bf7-a691-7fa9f200986f req-bdfa323f-89d3-4ef0-bf2a-d8c907a7107a service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:06.664303 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-7f45e98c-1379-4bf7-a691-7fa9f200986f req-bdfa323f-89d3-4ef0-bf2a-d8c907a7107a service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:06.675236 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-7f45e98c-1379-4bf7-a691-7fa9f200986f req-bdfa323f-89d3-4ef0-bf2a-d8c907a7107a service nova] Creating event network-vif-deleted:31dbb14f-e111-495f-87c5-4ba2c1afb4a7 for instance 24657b06-5ef6-429a-bce1-db0da36fea71 on hv-cinder-84327 Jun 15 14:50:06.680081 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-7f45e98c-1379-4bf7-a691-7fa9f200986f req-bdfa323f-89d3-4ef0-bf2a-d8c907a7107a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028125 Jun 15 14:50:06.680678 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 404/833] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:06.815180 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-68fd1c9c-060a-4ecd-989b-bcd11f9afd7a tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:06.822662 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-68fd1c9c-060a-4ecd-989b-bcd11f9afd7a tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 200 len: 1265 microversion: 2.1 time: 0.201696 Jun 15 14:50:06.823202 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 430/834] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:06 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:06.913078 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-ea9248b4-bee6-415c-ac1c-a6eb5cc54c4f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:06.914126 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-ea9248b4-bee6-415c-ac1c-a6eb5cc54c4f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:06.924945 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ea9248b4-bee6-415c-ac1c-a6eb5cc54c4f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:06.925525 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ea9248b4-bee6-415c-ac1c-a6eb5cc54c4f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:06.926612 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ea9248b4-bee6-415c-ac1c-a6eb5cc54c4f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:06.927317 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ea9248b4-bee6-415c-ac1c-a6eb5cc54c4f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:07.081975 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ea9248b4-bee6-415c-ac1c-a6eb5cc54c4f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:07.090230 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ea9248b4-bee6-415c-ac1c-a6eb5cc54c4f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:07.091779 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ea9248b4-bee6-415c-ac1c-a6eb5cc54c4f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:07.093017 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-ea9248b4-bee6-415c-ac1c-a6eb5cc54c4f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1741 microversion: 2.20 time: 0.184253 Jun 15 14:50:07.093556 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 405/835] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:06 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:07.324852 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c1e6723b-bf5e-4195-b1e2-c6a7162f0c19 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:07.325472 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c1e6723b-bf5e-4195-b1e2-c6a7162f0c19 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:07.328723 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:07.332633 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c1e6723b-bf5e-4195-b1e2-c6a7162f0c19 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:07.333086 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c1e6723b-bf5e-4195-b1e2-c6a7162f0c19 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:07.333885 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c1e6723b-bf5e-4195-b1e2-c6a7162f0c19 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:07.334327 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c1e6723b-bf5e-4195-b1e2-c6a7162f0c19 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:07.372104 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c1e6723b-bf5e-4195-b1e2-c6a7162f0c19 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:07.372558 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c1e6723b-bf5e-4195-b1e2-c6a7162f0c19 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:07.373017 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.objects.instance [None req-c1e6723b-bf5e-4195-b1e2-c6a7162f0c19 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lazy-loading 'fault' on Instance uuid 24657b06-5ef6-429a-bce1-db0da36fea71 {{(pid=124219) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:50:07.431130 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c1e6723b-bf5e-4195-b1e2-c6a7162f0c19 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7372fed3e14f3e98ca25d22a7c7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36b3b04f046d3bee421c5987b965b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:07.439535 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-c1e6723b-bf5e-4195-b1e2-c6a7162f0c19 tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 200 len: 1311 microversion: 2.1 time: 0.118701 Jun 15 14:50:07.440353 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 431/836] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:07 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 1311 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:07.637614 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-0edf6cd8-affe-4360-9bb0-711dbf767a07 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:07.638263 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-0edf6cd8-affe-4360-9bb0-711dbf767a07 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:07.640979 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=2 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:07.641968 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=8 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:07.648032 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0edf6cd8-affe-4360-9bb0-711dbf767a07 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:07.648480 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0edf6cd8-affe-4360-9bb0-711dbf767a07 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:07.649260 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0edf6cd8-affe-4360-9bb0-711dbf767a07 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:07.649707 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0edf6cd8-affe-4360-9bb0-711dbf767a07 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:07.784542 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-0edf6cd8-affe-4360-9bb0-711dbf767a07 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:07.791938 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-0edf6cd8-affe-4360-9bb0-711dbf767a07 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1566 microversion: 2.1 time: 0.158195 Jun 15 14:50:07.792495 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 406/837] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:07 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:07.840177 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-9a7a4c3f-8eab-4c6a-99c4-434051838860 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:07.840796 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-9a7a4c3f-8eab-4c6a-99c4-434051838860 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:07.847972 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9a7a4c3f-8eab-4c6a-99c4-434051838860 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:07.848683 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9a7a4c3f-8eab-4c6a-99c4-434051838860 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:07.849446 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9a7a4c3f-8eab-4c6a-99c4-434051838860 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:07.849915 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9a7a4c3f-8eab-4c6a-99c4-434051838860 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:07.983833 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-9a7a4c3f-8eab-4c6a-99c4-434051838860 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:07.991225 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-9a7a4c3f-8eab-4c6a-99c4-434051838860 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 200 len: 1265 microversion: 2.1 time: 0.155043 Jun 15 14:50:07.991792 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 432/838] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:07 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:08.112193 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6b50fb8a-5013-4e10-8f76-1a3db840b597 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:08.112804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6b50fb8a-5013-4e10-8f76-1a3db840b597 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:08.118803 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6b50fb8a-5013-4e10-8f76-1a3db840b597 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:08.119592 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6b50fb8a-5013-4e10-8f76-1a3db840b597 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:08.120450 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6b50fb8a-5013-4e10-8f76-1a3db840b597 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:08.121066 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6b50fb8a-5013-4e10-8f76-1a3db840b597 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:08.248322 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6b50fb8a-5013-4e10-8f76-1a3db840b597 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:08.256610 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6b50fb8a-5013-4e10-8f76-1a3db840b597 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:08.258137 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6b50fb8a-5013-4e10-8f76-1a3db840b597 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:08.259291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-6b50fb8a-5013-4e10-8f76-1a3db840b597 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1741 microversion: 2.20 time: 0.151861 Jun 15 14:50:08.259849 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 407/839] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:08 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1741 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:08.456691 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-8e1d7594-0872-428d-8c90-7e5c43b4b2fb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:08.457312 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-8e1d7594-0872-428d-8c90-7e5c43b4b2fb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] [instance: 24657b06-5ef6-429a-bce1-db0da36fea71] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:08.463438 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8e1d7594-0872-428d-8c90-7e5c43b4b2fb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:08.463894 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8e1d7594-0872-428d-8c90-7e5c43b4b2fb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:08.464664 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8e1d7594-0872-428d-8c90-7e5c43b4b2fb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:08.465105 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8e1d7594-0872-428d-8c90-7e5c43b4b2fb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:08.479179 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-8e1d7594-0872-428d-8c90-7e5c43b4b2fb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] HTTP exception thrown: Instance 24657b06-5ef6-429a-bce1-db0da36fea71 could not be found. Jun 15 14:50:08.480839 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-8e1d7594-0872-428d-8c90-7e5c43b4b2fb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Request method failure captured: Jun 15 14:50:08.480839 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 HTTP/1.1 Jun 15 14:50:08.480839 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:50:08.480839 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:50:08.480839 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:50:08.480839 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:50:08.480839 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:50:08.480839 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:50:08.480839 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:50:08.480839 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:50:08.480839 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfAJ8wPnkqs_k4Bo8GSWGVuB1Ap-R1u4L7mH2U3HEuvWVNvlRBO_qyAD7QzOZMMEzF_zcaK0X4c1eXso_54pW74XDCCkghDRm0zR7H0M-gVJaO4FWuw9AQkWNKuoAF0zQpil6wRuiB3fOyyvDJwL5UyfZxFCESuQo14vuw2L05AA968 Jun 15 14:50:08.480839 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:50:08.480839 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:50:08.480839 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:50:08.480839 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:50:08.480839 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:50:08.480839 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:50:08.480839 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 26d36b3b04f046d3bee421c5987b965b Jun 15 14:50:08.480839 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1197112882 Jun 15 14:50:08.480839 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:50:08.480839 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:50:08.482554 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/26d36b3b04f046d3bee421c5987b965b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_26d36b3b04f046d3bee421c5987b965b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/26d36b3b04f046d3bee421c5987b965b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/26d36b3b04f046d3bee421c5987b965b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:50:08.482554 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1197112882 Jun 15 14:50:08.482554 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 26d36b3b04f046d3bee421c5987b965b Jun 15 14:50:08.482554 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1197112882 Jun 15 14:50:08.482554 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-ServerRescueNegativeTestJSON-1197112882-project Jun 15 14:50:08.482554 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:50:08.482554 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:50:08.482554 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: ed7372fed3e14f3e98ca25d22a7c7a7e Jun 15 14:50:08.482554 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1197112882-project Jun 15 14:50:08.482554 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:50:08.482554 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Instance 24657b06-5ef6-429a-bce1-db0da36fea71 could not be found. Jun 15 14:50:08.482554 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': '24657b06-5ef6-429a-bce1-db0da36fea71'} Jun 15 14:50:08.484855 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:50:08.484855 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:50:08.484855 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:50:08.484855 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:50:08.484855 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:50:08.484855 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:50:08.484855 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:50:08.484855 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:50:08.484855 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:50:08.484855 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:50:08.484855 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24657b06-5ef6-429a-bce1-db0da36fea71 could not be found. Jun 15 14:50:08.484855 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:50:08.484855 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:50:08.484855 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:50:08.484855 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:50:08.484855 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:50:08.484855 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:50:08.484855 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:50:08.484855 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:50:08.484855 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:50:08.486500 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:50:08.486500 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:50:08.486500 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:50:08.486500 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:50:08.486500 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:50:08.486500 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:50:08.486500 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:50:08.486500 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24657b06-5ef6-429a-bce1-db0da36fea71 could not be found. Jun 15 14:50:08.486500 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:50:08.486500 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:50:08.486500 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:50:08.486500 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:50:08.486500 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:50:08.486500 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:50:08.486500 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:50:08.486500 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:50:08.486500 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24657b06-5ef6-429a-bce1-db0da36fea71 could not be found. Jun 15 14:50:08.486500 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:50:08.487847 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-8e1d7594-0872-428d-8c90-7e5c43b4b2fb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] Returning 404 to user: Instance 24657b06-5ef6-429a-bce1-db0da36fea71 could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:50:08.487847 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-8e1d7594-0872-428d-8c90-7e5c43b4b2fb tempest-ServerRescueNegativeTestJSON-1197112882 tempest-ServerRescueNegativeTestJSON-1197112882-project] 10.222.0.57 "GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71" status: 404 len: 111 microversion: 2.1 time: 0.029608 Jun 15 14:50:08.487847 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 433/840] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:08 2022] GET /compute/v2.1/servers/24657b06-5ef6-429a-bce1-db0da36fea71 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:50:08.809226 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-59258634-efe0-470d-ba0e-51a542c15493 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:08.809864 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-59258634-efe0-470d-ba0e-51a542c15493 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:08.816393 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-59258634-efe0-470d-ba0e-51a542c15493 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:08.816843 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-59258634-efe0-470d-ba0e-51a542c15493 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:08.817613 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-59258634-efe0-470d-ba0e-51a542c15493 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:08.818145 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-59258634-efe0-470d-ba0e-51a542c15493 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:08.966416 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-59258634-efe0-470d-ba0e-51a542c15493 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:08.976356 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-59258634-efe0-470d-ba0e-51a542c15493 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1566 microversion: 2.1 time: 0.170723 Jun 15 14:50:08.978687 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 408/841] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:08 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:09.008257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-fb71ea31-2427-4111-9a92-ed4e7c209558 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:09.008884 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-fb71ea31-2427-4111-9a92-ed4e7c209558 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:09.016261 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fb71ea31-2427-4111-9a92-ed4e7c209558 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:09.017077 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fb71ea31-2427-4111-9a92-ed4e7c209558 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:09.017953 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fb71ea31-2427-4111-9a92-ed4e7c209558 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:09.018470 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fb71ea31-2427-4111-9a92-ed4e7c209558 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:09.226715 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-fb71ea31-2427-4111-9a92-ed4e7c209558 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:09.234617 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-fb71ea31-2427-4111-9a92-ed4e7c209558 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 200 len: 1265 microversion: 2.1 time: 0.230051 Jun 15 14:50:09.235179 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 434/842] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:09 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:09.277952 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-9fcbbe39-5373-45b8-abc7-2d209a1a5a92 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:09.279218 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-9fcbbe39-5373-45b8-abc7-2d209a1a5a92 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:09.286365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9fcbbe39-5373-45b8-abc7-2d209a1a5a92 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:09.286895 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9fcbbe39-5373-45b8-abc7-2d209a1a5a92 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:09.287800 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9fcbbe39-5373-45b8-abc7-2d209a1a5a92 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:09.288244 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9fcbbe39-5373-45b8-abc7-2d209a1a5a92 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:09.421014 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9fcbbe39-5373-45b8-abc7-2d209a1a5a92 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:09.429279 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9fcbbe39-5373-45b8-abc7-2d209a1a5a92 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:09.430804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9fcbbe39-5373-45b8-abc7-2d209a1a5a92 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:09.431969 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-9fcbbe39-5373-45b8-abc7-2d209a1a5a92 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1741 microversion: 2.20 time: 0.158080 Jun 15 14:50:09.432524 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 409/843] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:09 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:09.993953 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0a1efed9-e4f9-4fbe-a9b0-b462b07b1ea0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:09.994669 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-0a1efed9-e4f9-4fbe-a9b0-b462b07b1ea0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:10.002013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0a1efed9-e4f9-4fbe-a9b0-b462b07b1ea0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:10.002584 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0a1efed9-e4f9-4fbe-a9b0-b462b07b1ea0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:10.003441 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0a1efed9-e4f9-4fbe-a9b0-b462b07b1ea0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:10.003916 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0a1efed9-e4f9-4fbe-a9b0-b462b07b1ea0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:10.169190 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0a1efed9-e4f9-4fbe-a9b0-b462b07b1ea0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:10.180058 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-0a1efed9-e4f9-4fbe-a9b0-b462b07b1ea0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1566 microversion: 2.1 time: 0.189993 Jun 15 14:50:10.181974 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 435/844] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:09 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1566 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:10.252131 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-621a213c-25c5-4230-bea6-0951126dc4b2 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:10.256326 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-621a213c-25c5-4230-bea6-0951126dc4b2 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:10.264031 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-621a213c-25c5-4230-bea6-0951126dc4b2 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:10.265296 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-621a213c-25c5-4230-bea6-0951126dc4b2 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:10.266730 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-621a213c-25c5-4230-bea6-0951126dc4b2 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:10.267714 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-621a213c-25c5-4230-bea6-0951126dc4b2 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:10.450793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-58d8d0cd-2ab7-46f4-8af6-952952a0776d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:10.451425 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-58d8d0cd-2ab7-46f4-8af6-952952a0776d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:10.461089 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-58d8d0cd-2ab7-46f4-8af6-952952a0776d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:10.461883 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-58d8d0cd-2ab7-46f4-8af6-952952a0776d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:10.462371 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-58d8d0cd-2ab7-46f4-8af6-952952a0776d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:10.462843 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-58d8d0cd-2ab7-46f4-8af6-952952a0776d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:10.521932 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-621a213c-25c5-4230-bea6-0951126dc4b2 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:10.531138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-621a213c-25c5-4230-bea6-0951126dc4b2 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 200 len: 1265 microversion: 2.1 time: 0.282088 Jun 15 14:50:10.534356 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 410/845] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:10 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 1265 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:10.643222 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-58d8d0cd-2ab7-46f4-8af6-952952a0776d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:10.653123 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-58d8d0cd-2ab7-46f4-8af6-952952a0776d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:10.655297 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-58d8d0cd-2ab7-46f4-8af6-952952a0776d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:10.656963 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-58d8d0cd-2ab7-46f4-8af6-952952a0776d tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1736 microversion: 2.20 time: 0.210153 Jun 15 14:50:10.658193 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 436/846] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:10 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:10.889771 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-d5479b0d-15b0-407a-aa66-e4e238f1982b req-d15035b5-e168-41d6-9824-98ab2162fb21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d0cbdc8-d87b-4ce4-97d1-59aca342287a", "name": "network-vif-plugged", "status": "completed", "tag": "bf1963f9-4d7c-4562-9c53-6c53a728e8c6"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:10.898268 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:10.912222 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-d5479b0d-15b0-407a-aa66-e4e238f1982b req-d15035b5-e168-41d6-9824-98ab2162fb21 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:10.917907 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-d5479b0d-15b0-407a-aa66-e4e238f1982b req-d15035b5-e168-41d6-9824-98ab2162fb21 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:10.947162 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-d5479b0d-15b0-407a-aa66-e4e238f1982b req-d15035b5-e168-41d6-9824-98ab2162fb21 service nova] Creating event network-vif-plugged:bf1963f9-4d7c-4562-9c53-6c53a728e8c6 for instance 7d0cbdc8-d87b-4ce4-97d1-59aca342287a on hv-cinder-84327 Jun 15 14:50:10.962457 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-d5479b0d-15b0-407a-aa66-e4e238f1982b req-d15035b5-e168-41d6-9824-98ab2162fb21 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076733 Jun 15 14:50:10.966338 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 411/847] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:11.216545 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-4a27a651-fee5-491f-8dbb-7fce5d532a97 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:11.224055 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-4a27a651-fee5-491f-8dbb-7fce5d532a97 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:11.242428 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4a27a651-fee5-491f-8dbb-7fce5d532a97 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:11.245887 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4a27a651-fee5-491f-8dbb-7fce5d532a97 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:11.246764 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4a27a651-fee5-491f-8dbb-7fce5d532a97 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:11.247272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4a27a651-fee5-491f-8dbb-7fce5d532a97 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:11.534717 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-4a27a651-fee5-491f-8dbb-7fce5d532a97 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:11.548283 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-4a27a651-fee5-491f-8dbb-7fce5d532a97 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1566 microversion: 2.1 time: 0.353103 Jun 15 14:50:11.552972 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 437/848] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:11 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1566 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:11.556624 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-98c761b0-62ce-4d48-acbe-235b1d42c6ea tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:11.558713 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-98c761b0-62ce-4d48-acbe-235b1d42c6ea tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:11.566489 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-98c761b0-62ce-4d48-acbe-235b1d42c6ea tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:11.567023 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-98c761b0-62ce-4d48-acbe-235b1d42c6ea tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:11.568332 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-98c761b0-62ce-4d48-acbe-235b1d42c6ea tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:11.568969 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-98c761b0-62ce-4d48-acbe-235b1d42c6ea tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:11.678548 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e75ab9b2-4dd5-4b72-be9b-6aefe4e2e046 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:11.679403 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-e75ab9b2-4dd5-4b72-be9b-6aefe4e2e046 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:11.688293 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e75ab9b2-4dd5-4b72-be9b-6aefe4e2e046 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:11.689093 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e75ab9b2-4dd5-4b72-be9b-6aefe4e2e046 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:11.690854 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e75ab9b2-4dd5-4b72-be9b-6aefe4e2e046 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:11.691771 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e75ab9b2-4dd5-4b72-be9b-6aefe4e2e046 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:11.777059 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=100 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:11.850040 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-98c761b0-62ce-4d48-acbe-235b1d42c6ea tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:11.859660 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-98c761b0-62ce-4d48-acbe-235b1d42c6ea tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 200 len: 1265 microversion: 2.1 time: 0.313300 Jun 15 14:50:11.860595 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 412/849] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:11 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 1265 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:12.134268 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e75ab9b2-4dd5-4b72-be9b-6aefe4e2e046 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:12.151675 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e75ab9b2-4dd5-4b72-be9b-6aefe4e2e046 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:12.160133 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e75ab9b2-4dd5-4b72-be9b-6aefe4e2e046 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:12.164279 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-e75ab9b2-4dd5-4b72-be9b-6aefe4e2e046 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1736 microversion: 2.20 time: 0.489651 Jun 15 14:50:12.166043 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 438/850] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:11 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1736 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:12.566398 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6b183ab4-b72f-4dc4-afb3-539e22a20878 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:12.567025 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6b183ab4-b72f-4dc4-afb3-539e22a20878 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:12.573871 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6b183ab4-b72f-4dc4-afb3-539e22a20878 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:12.574584 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6b183ab4-b72f-4dc4-afb3-539e22a20878 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:12.575414 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6b183ab4-b72f-4dc4-afb3-539e22a20878 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:12.575802 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6b183ab4-b72f-4dc4-afb3-539e22a20878 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:12.755601 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6b183ab4-b72f-4dc4-afb3-539e22a20878 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:12.764278 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-6b183ab4-b72f-4dc4-afb3-539e22a20878 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1566 microversion: 2.1 time: 0.202889 Jun 15 14:50:12.766012 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 413/851] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:12 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1566 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:12.879876 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-44a6d9b6-0dc6-4311-a487-6c649b5440f4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:12.880497 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-44a6d9b6-0dc6-4311-a487-6c649b5440f4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:12.887418 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-44a6d9b6-0dc6-4311-a487-6c649b5440f4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:12.888073 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-44a6d9b6-0dc6-4311-a487-6c649b5440f4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:12.889070 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-44a6d9b6-0dc6-4311-a487-6c649b5440f4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:12.889771 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-44a6d9b6-0dc6-4311-a487-6c649b5440f4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:13.084144 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-44a6d9b6-0dc6-4311-a487-6c649b5440f4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:13.097538 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-44a6d9b6-0dc6-4311-a487-6c649b5440f4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 200 len: 1265 microversion: 2.1 time: 0.224839 Jun 15 14:50:13.099608 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 439/852] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:12 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:13.184003 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-ccd00e05-ce1f-4f4a-b5d8-5c75af86b874 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:13.184626 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-ccd00e05-ce1f-4f4a-b5d8-5c75af86b874 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:13.192949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ccd00e05-ce1f-4f4a-b5d8-5c75af86b874 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:13.193679 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ccd00e05-ce1f-4f4a-b5d8-5c75af86b874 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:13.194463 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ccd00e05-ce1f-4f4a-b5d8-5c75af86b874 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:13.195063 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ccd00e05-ce1f-4f4a-b5d8-5c75af86b874 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:13.464441 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ccd00e05-ce1f-4f4a-b5d8-5c75af86b874 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:13.473445 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ccd00e05-ce1f-4f4a-b5d8-5c75af86b874 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:13.476896 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ccd00e05-ce1f-4f4a-b5d8-5c75af86b874 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:13.478320 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-ccd00e05-ce1f-4f4a-b5d8-5c75af86b874 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1736 microversion: 2.20 time: 0.298102 Jun 15 14:50:13.479051 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 414/853] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:13 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1736 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:50:13.783706 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e28e0c49-1ea0-44f2-beab-a7d6964c1d97 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:13.784472 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-e28e0c49-1ea0-44f2-beab-a7d6964c1d97 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:13.790661 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e28e0c49-1ea0-44f2-beab-a7d6964c1d97 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:13.797869 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e28e0c49-1ea0-44f2-beab-a7d6964c1d97 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:13.805990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e28e0c49-1ea0-44f2-beab-a7d6964c1d97 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:13.806451 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e28e0c49-1ea0-44f2-beab-a7d6964c1d97 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:13.974726 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e28e0c49-1ea0-44f2-beab-a7d6964c1d97 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:13.992398 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-e28e0c49-1ea0-44f2-beab-a7d6964c1d97 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1566 microversion: 2.1 time: 0.214211 Jun 15 14:50:14.002259 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 440/854] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:13 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1566 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:14.116254 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-79a776f1-d186-448c-8eee-2ba3f3a1462a tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:14.116990 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-79a776f1-d186-448c-8eee-2ba3f3a1462a tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:14.127781 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-79a776f1-d186-448c-8eee-2ba3f3a1462a tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:14.128922 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-79a776f1-d186-448c-8eee-2ba3f3a1462a tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:14.129838 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-79a776f1-d186-448c-8eee-2ba3f3a1462a tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:14.130929 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-79a776f1-d186-448c-8eee-2ba3f3a1462a tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:14.162103 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=100 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:14.329927 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-79a776f1-d186-448c-8eee-2ba3f3a1462a tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:14.339255 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-79a776f1-d186-448c-8eee-2ba3f3a1462a tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 200 len: 1265 microversion: 2.1 time: 0.225474 Jun 15 14:50:14.348511 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 415/855] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:14 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:14.496380 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-d67650e7-7c8b-4f01-b50d-48f2d387b258 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:14.498026 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-d67650e7-7c8b-4f01-b50d-48f2d387b258 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:14.507761 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d67650e7-7c8b-4f01-b50d-48f2d387b258 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:14.508591 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d67650e7-7c8b-4f01-b50d-48f2d387b258 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:14.509585 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d67650e7-7c8b-4f01-b50d-48f2d387b258 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:14.510307 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d67650e7-7c8b-4f01-b50d-48f2d387b258 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:14.736264 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d67650e7-7c8b-4f01-b50d-48f2d387b258 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:14.747014 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d67650e7-7c8b-4f01-b50d-48f2d387b258 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:14.751521 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d67650e7-7c8b-4f01-b50d-48f2d387b258 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:14.752734 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-d67650e7-7c8b-4f01-b50d-48f2d387b258 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1736 microversion: 2.20 time: 0.260271 Jun 15 14:50:14.764377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 441/856] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:14 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1736 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:15.009905 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-4ac2ef6b-7df7-4f6b-a62c-6c98ef9e75ba tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:15.010897 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-4ac2ef6b-7df7-4f6b-a62c-6c98ef9e75ba tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:15.022361 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4ac2ef6b-7df7-4f6b-a62c-6c98ef9e75ba tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:15.023065 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4ac2ef6b-7df7-4f6b-a62c-6c98ef9e75ba tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:15.024053 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4ac2ef6b-7df7-4f6b-a62c-6c98ef9e75ba tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:15.024529 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4ac2ef6b-7df7-4f6b-a62c-6c98ef9e75ba tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:15.226242 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-4ac2ef6b-7df7-4f6b-a62c-6c98ef9e75ba tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:15.236975 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-4ac2ef6b-7df7-4f6b-a62c-6c98ef9e75ba tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1566 microversion: 2.1 time: 0.230889 Jun 15 14:50:15.238521 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 416/857] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:15 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1566 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:15.355554 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-4ec3e79f-a461-4694-aa75-896ef9f0d211 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:15.356929 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-4ec3e79f-a461-4694-aa75-896ef9f0d211 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:15.363952 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4ec3e79f-a461-4694-aa75-896ef9f0d211 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:15.371272 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4ec3e79f-a461-4694-aa75-896ef9f0d211 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:15.372108 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4ec3e79f-a461-4694-aa75-896ef9f0d211 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:15.372557 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4ec3e79f-a461-4694-aa75-896ef9f0d211 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:15.771220 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-bf646e3a-2623-44f8-9463-baa52f87a167 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:15.772103 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-bf646e3a-2623-44f8-9463-baa52f87a167 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:15.778457 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-bf646e3a-2623-44f8-9463-baa52f87a167 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:15.779221 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-bf646e3a-2623-44f8-9463-baa52f87a167 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:15.780805 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-bf646e3a-2623-44f8-9463-baa52f87a167 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:15.781598 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-bf646e3a-2623-44f8-9463-baa52f87a167 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:15.810002 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-4ec3e79f-a461-4694-aa75-896ef9f0d211 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:15.817503 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-4ec3e79f-a461-4694-aa75-896ef9f0d211 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 200 len: 1265 microversion: 2.1 time: 0.465978 Jun 15 14:50:15.818139 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 442/858] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:15 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 1265 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:15.959864 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-bf646e3a-2623-44f8-9463-baa52f87a167 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:15.970783 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-bf646e3a-2623-44f8-9463-baa52f87a167 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:15.972699 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-bf646e3a-2623-44f8-9463-baa52f87a167 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:15.974796 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-bf646e3a-2623-44f8-9463-baa52f87a167 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1736 microversion: 2.20 time: 0.207284 Jun 15 14:50:15.986505 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 417/859] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:15 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:16.256237 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-2f0b39dc-83b6-45c5-8fc4-953f40215823 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:16.256846 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-2f0b39dc-83b6-45c5-8fc4-953f40215823 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:16.263958 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2f0b39dc-83b6-45c5-8fc4-953f40215823 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:16.264972 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2f0b39dc-83b6-45c5-8fc4-953f40215823 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:16.266337 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2f0b39dc-83b6-45c5-8fc4-953f40215823 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:16.267158 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2f0b39dc-83b6-45c5-8fc4-953f40215823 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:16.611969 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-2f0b39dc-83b6-45c5-8fc4-953f40215823 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:16.626161 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-2f0b39dc-83b6-45c5-8fc4-953f40215823 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1566 microversion: 2.1 time: 0.374349 Jun 15 14:50:16.626776 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 443/860] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:16 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1566 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:16.835035 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a38bb336-a79f-464a-b206-017b471da8b7 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:16.835568 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a38bb336-a79f-464a-b206-017b471da8b7 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:16.856162 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a38bb336-a79f-464a-b206-017b471da8b7 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:16.856607 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a38bb336-a79f-464a-b206-017b471da8b7 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:16.861316 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a38bb336-a79f-464a-b206-017b471da8b7 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:16.861982 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a38bb336-a79f-464a-b206-017b471da8b7 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:16.992999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-343bd5d8-1985-4586-a8e8-efa1b7ce5a91 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:16.993769 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-343bd5d8-1985-4586-a8e8-efa1b7ce5a91 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:17.012741 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-343bd5d8-1985-4586-a8e8-efa1b7ce5a91 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:17.013232 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-343bd5d8-1985-4586-a8e8-efa1b7ce5a91 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:17.014052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-343bd5d8-1985-4586-a8e8-efa1b7ce5a91 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:17.014497 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-343bd5d8-1985-4586-a8e8-efa1b7ce5a91 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:17.129984 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a38bb336-a79f-464a-b206-017b471da8b7 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:17.138014 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a38bb336-a79f-464a-b206-017b471da8b7 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 200 len: 1265 microversion: 2.1 time: 0.307013 Jun 15 14:50:17.139485 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 418/861] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:16 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 1265 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:17.165512 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-10c22975-f68b-4bd5-b69f-4a5bcf4a1bf3 req-9bc35563-bad6-4a2b-9588-c93337bded71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef2057b-c064-4900-a338-f86a4383746f", "name": "network-vif-plugged", "status": "completed", "tag": "a2b93273-5f17-40f1-81a6-00e33227d97a"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:17.176184 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-10c22975-f68b-4bd5-b69f-4a5bcf4a1bf3 req-9bc35563-bad6-4a2b-9588-c93337bded71 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:17.177028 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-10c22975-f68b-4bd5-b69f-4a5bcf4a1bf3 req-9bc35563-bad6-4a2b-9588-c93337bded71 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:17.193455 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-10c22975-f68b-4bd5-b69f-4a5bcf4a1bf3 req-9bc35563-bad6-4a2b-9588-c93337bded71 service nova] Creating event network-vif-plugged:a2b93273-5f17-40f1-81a6-00e33227d97a for instance 6ef2057b-c064-4900-a338-f86a4383746f on hv-cinder-84327 Jun 15 14:50:17.205349 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-10c22975-f68b-4bd5-b69f-4a5bcf4a1bf3 req-9bc35563-bad6-4a2b-9588-c93337bded71 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045410 Jun 15 14:50:17.208178 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 419/862] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:17.267539 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-343bd5d8-1985-4586-a8e8-efa1b7ce5a91 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:17.290742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-343bd5d8-1985-4586-a8e8-efa1b7ce5a91 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:17.311962 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-343bd5d8-1985-4586-a8e8-efa1b7ce5a91 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:17.323946 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-343bd5d8-1985-4586-a8e8-efa1b7ce5a91 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1736 microversion: 2.20 time: 0.324744 Jun 15 14:50:17.344163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 444/863] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:16 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1736 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:50:17.645003 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-0ab3ff57-135e-45e5-9e2e-09e0c404149c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:17.646203 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-0ab3ff57-135e-45e5-9e2e-09e0c404149c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:17.659598 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0ab3ff57-135e-45e5-9e2e-09e0c404149c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:17.666294 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0ab3ff57-135e-45e5-9e2e-09e0c404149c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:17.670713 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0ab3ff57-135e-45e5-9e2e-09e0c404149c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:17.673301 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0ab3ff57-135e-45e5-9e2e-09e0c404149c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:18.053939 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-0ab3ff57-135e-45e5-9e2e-09e0c404149c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:18.069651 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-0ab3ff57-135e-45e5-9e2e-09e0c404149c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1507 microversion: 2.1 time: 0.429797 Jun 15 14:50:18.072836 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 420/864] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:17 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1507 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:18.092371 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-6f163515-1b05-48a9-9349-1af9377adb8c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:18.094024 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-6f163515-1b05-48a9-9349-1af9377adb8c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:18.109294 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6f163515-1b05-48a9-9349-1af9377adb8c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:18.110133 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6f163515-1b05-48a9-9349-1af9377adb8c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:18.112984 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6f163515-1b05-48a9-9349-1af9377adb8c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:18.113686 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6f163515-1b05-48a9-9349-1af9377adb8c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:18.157928 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1cbde05b-344a-40fa-8bf9-0f40d20d974f tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:18.159644 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1cbde05b-344a-40fa-8bf9-0f40d20d974f tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:18.170364 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1cbde05b-344a-40fa-8bf9-0f40d20d974f tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:18.173113 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1cbde05b-344a-40fa-8bf9-0f40d20d974f tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:18.176066 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1cbde05b-344a-40fa-8bf9-0f40d20d974f tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:18.177935 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1cbde05b-344a-40fa-8bf9-0f40d20d974f tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:18.305219 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-6f163515-1b05-48a9-9349-1af9377adb8c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "POST /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531/action" status: 202 len: 0 microversion: 2.1 time: 0.217444 Jun 15 14:50:18.311112 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 445/865] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 14:50:18 2022] POST /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:50:18.318594 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-89f2e7a3-7cbf-4e3a-b265-b13cda12c15e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:18.320159 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-89f2e7a3-7cbf-4e3a-b265-b13cda12c15e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:18.332992 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-89f2e7a3-7cbf-4e3a-b265-b13cda12c15e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:18.334170 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-89f2e7a3-7cbf-4e3a-b265-b13cda12c15e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:18.335276 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-89f2e7a3-7cbf-4e3a-b265-b13cda12c15e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:18.336050 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-89f2e7a3-7cbf-4e3a-b265-b13cda12c15e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:18.549047 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-1cbde05b-344a-40fa-8bf9-0f40d20d974f tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:18.570798 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-1cbde05b-344a-40fa-8bf9-0f40d20d974f tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 200 len: 1265 microversion: 2.1 time: 0.417722 Jun 15 14:50:18.571390 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 421/866] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:18 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 1265 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:18.576047 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-4e1759a4-a67e-4f41-8b99-ac788f848eac tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:18.576646 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-4e1759a4-a67e-4f41-8b99-ac788f848eac tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:18.600387 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4e1759a4-a67e-4f41-8b99-ac788f848eac tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:18.600881 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4e1759a4-a67e-4f41-8b99-ac788f848eac tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:18.601707 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4e1759a4-a67e-4f41-8b99-ac788f848eac tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:18.602125 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4e1759a4-a67e-4f41-8b99-ac788f848eac tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:18.786955 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-89f2e7a3-7cbf-4e3a-b265-b13cda12c15e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:18.795632 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-89f2e7a3-7cbf-4e3a-b265-b13cda12c15e tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1515 microversion: 2.1 time: 0.482818 Jun 15 14:50:18.802141 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 446/867] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:18 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1515 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:19.002951 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-4e1759a4-a67e-4f41-8b99-ac788f848eac tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:19.012448 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-4e1759a4-a67e-4f41-8b99-ac788f848eac tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:19.019295 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-4e1759a4-a67e-4f41-8b99-ac788f848eac tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:19.023599 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-4e1759a4-a67e-4f41-8b99-ac788f848eac tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1736 microversion: 2.20 time: 0.451110 Jun 15 14:50:19.035662 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 422/868] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:18 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1736 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:19.612853 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-523c30c4-7148-497f-b223-647e5f651294 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:19.613478 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-523c30c4-7148-497f-b223-647e5f651294 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:19.624792 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-523c30c4-7148-497f-b223-647e5f651294 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:19.625734 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-523c30c4-7148-497f-b223-647e5f651294 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:19.626859 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-523c30c4-7148-497f-b223-647e5f651294 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:19.627636 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-523c30c4-7148-497f-b223-647e5f651294 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:19.818720 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c29a9f5e-d104-4f70-9b3d-808450b223b0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:19.819341 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-c29a9f5e-d104-4f70-9b3d-808450b223b0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:19.828944 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c29a9f5e-d104-4f70-9b3d-808450b223b0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:19.835658 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c29a9f5e-d104-4f70-9b3d-808450b223b0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:19.836992 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c29a9f5e-d104-4f70-9b3d-808450b223b0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:19.838259 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c29a9f5e-d104-4f70-9b3d-808450b223b0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:19.847388 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-523c30c4-7148-497f-b223-647e5f651294 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:19.857166 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-523c30c4-7148-497f-b223-647e5f651294 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 200 len: 1265 microversion: 2.1 time: 0.248538 Jun 15 14:50:19.868391 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 447/869] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:19 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:20.042250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-a1d32e8f-dad4-4b08-8af2-f2c3742d251f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:20.043131 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-a1d32e8f-dad4-4b08-8af2-f2c3742d251f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:20.058391 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a1d32e8f-dad4-4b08-8af2-f2c3742d251f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:20.059213 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a1d32e8f-dad4-4b08-8af2-f2c3742d251f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:20.060456 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a1d32e8f-dad4-4b08-8af2-f2c3742d251f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:20.061067 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a1d32e8f-dad4-4b08-8af2-f2c3742d251f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:20.248036 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-c29a9f5e-d104-4f70-9b3d-808450b223b0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:20.273249 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-c29a9f5e-d104-4f70-9b3d-808450b223b0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1515 microversion: 2.1 time: 0.453660 Jun 15 14:50:20.277577 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 423/870] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:19 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1515 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:20.346738 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-a1d32e8f-dad4-4b08-8af2-f2c3742d251f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:20.359279 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-a1d32e8f-dad4-4b08-8af2-f2c3742d251f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:20.361403 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-a1d32e8f-dad4-4b08-8af2-f2c3742d251f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:20.364133 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-a1d32e8f-dad4-4b08-8af2-f2c3742d251f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1736 microversion: 2.20 time: 0.325865 Jun 15 14:50:20.376015 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 448/871] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:20 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1736 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:50:20.877750 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-904393f6-3bb3-455b-8a16-3c275c4c2d78 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:20.879069 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-904393f6-3bb3-455b-8a16-3c275c4c2d78 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:20.886713 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-904393f6-3bb3-455b-8a16-3c275c4c2d78 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:20.887467 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-904393f6-3bb3-455b-8a16-3c275c4c2d78 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:20.888532 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-904393f6-3bb3-455b-8a16-3c275c4c2d78 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:20.889208 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-904393f6-3bb3-455b-8a16-3c275c4c2d78 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:21.010489 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-00e05ef8-3388-4871-82e5-a784a6fbf9bc req-cd06e366-3ea6-4957-b484-b64821d37ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fdd6732-ba3a-4243-a57f-7e84f8eea531", "name": "network-vif-unplugged", "status": "completed", "tag": "457c9267-d5cd-492d-9292-3d4518f9d2bb"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:21.030618 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-00e05ef8-3388-4871-82e5-a784a6fbf9bc req-cd06e366-3ea6-4957-b484-b64821d37ad5 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:21.031060 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-00e05ef8-3388-4871-82e5-a784a6fbf9bc req-cd06e366-3ea6-4957-b484-b64821d37ad5 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:21.086603 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.compute.server_external_events [req-00e05ef8-3388-4871-82e5-a784a6fbf9bc req-cd06e366-3ea6-4957-b484-b64821d37ad5 service nova] Unable to find a host for instance 3fdd6732-ba3a-4243-a57f-7e84f8eea531. Dropping event network-vif-unplugged {{(pid=124219) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 15 14:50:21.087675 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-00e05ef8-3388-4871-82e5-a784a6fbf9bc req-cd06e366-3ea6-4957-b484-b64821d37ad5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.082395 Jun 15 14:50:21.095309 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 449/872] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 90 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 15 14:50:21.163546 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-904393f6-3bb3-455b-8a16-3c275c4c2d78 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:21.173355 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-904393f6-3bb3-455b-8a16-3c275c4c2d78 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 200 len: 1452 microversion: 2.1 time: 0.301523 Jun 15 14:50:21.174270 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 424/873] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:20 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 1452 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:21.190645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-14f2a29e-a506-4a55-805c-16ad3fce5d1e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:21.191260 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-14f2a29e-a506-4a55-805c-16ad3fce5d1e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:21.209194 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-14f2a29e-a506-4a55-805c-16ad3fce5d1e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:21.209730 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-14f2a29e-a506-4a55-805c-16ad3fce5d1e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:21.210510 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-14f2a29e-a506-4a55-805c-16ad3fce5d1e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:21.212859 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-14f2a29e-a506-4a55-805c-16ad3fce5d1e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:21.300857 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-61effffd-1f59-4809-aafb-bf816e95f59d tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:21.301518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-61effffd-1f59-4809-aafb-bf816e95f59d tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:21.316028 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-61effffd-1f59-4809-aafb-bf816e95f59d tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:21.316472 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-61effffd-1f59-4809-aafb-bf816e95f59d tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:21.317328 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-61effffd-1f59-4809-aafb-bf816e95f59d tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:21.320326 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-61effffd-1f59-4809-aafb-bf816e95f59d tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:21.490868 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-14f2a29e-a506-4a55-805c-16ad3fce5d1e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:21.502014 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-14f2a29e-a506-4a55-805c-16ad3fce5d1e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 200 len: 1452 microversion: 2.1 time: 0.315503 Jun 15 14:50:21.503069 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 450/874] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:21 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 1452 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:21.508589 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-5ead4b91-39e0-40fd-acde-787c6c693ac9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:21.509503 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-5ead4b91-39e0-40fd-acde-787c6c693ac9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:21.542943 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5ead4b91-39e0-40fd-acde-787c6c693ac9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:21.543403 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5ead4b91-39e0-40fd-acde-787c6c693ac9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:21.544191 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5ead4b91-39e0-40fd-acde-787c6c693ac9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:21.544641 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5ead4b91-39e0-40fd-acde-787c6c693ac9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:21.692626 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-61effffd-1f59-4809-aafb-bf816e95f59d tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:21.703062 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-61effffd-1f59-4809-aafb-bf816e95f59d tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1517 microversion: 2.1 time: 0.407834 Jun 15 14:50:21.708103 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 425/875] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:21 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1517 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:21.816644 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-5ead4b91-39e0-40fd-acde-787c6c693ac9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:21.833553 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-5ead4b91-39e0-40fd-acde-787c6c693ac9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:21.835140 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-5ead4b91-39e0-40fd-acde-787c6c693ac9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:21.836328 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-5ead4b91-39e0-40fd-acde-787c6c693ac9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1736 microversion: 2.20 time: 0.332032 Jun 15 14:50:21.837462 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 451/876] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:21 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1736 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:21.963471 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-99b65a3a-e941-44f2-ae68-a40513393e68 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Action: 'create', calling method: .version_select at 0x7f8f134030d0>, body: {"keypair": {"name": "tempest-keypair-1273608603", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeQjYOHklkKKuo+JjeVs0sS26W4oKSsvX5fQuxm+b02n3/AkdZnxiR+S8Pw14LDRnfGGVDxf37nIWMUjIhSRqXJtBbSceZK1kkYCLMlJJ6jF+J2fhExeRG2pO+6SNsdDw=="}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:22.002515 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-99b65a3a-e941-44f2-ae68-a40513393e68 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Getting quotas for project 591d111357224477998b265d45e3ee0d. Resources: {'key_pairs'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:50:22.011663 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-99b65a3a-e941-44f2-ae68-a40513393e68 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Getting quotas for user 6caa64aecb914e968d057b6b593f667f and project 591d111357224477998b265d45e3ee0d. Resources: {'key_pairs'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:50:22.072183 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-99b65a3a-e941-44f2-ae68-a40513393e68 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.354466 Jun 15 14:50:22.073115 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 426/877] 10.222.0.57 () {60 vars in 1158 bytes} [Wed Jun 15 14:50:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:22.728146 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-a9416d45-1958-461b-9b3e-66e88a7699a8 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:22.729397 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-a9416d45-1958-461b-9b3e-66e88a7699a8 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:22.741857 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a9416d45-1958-461b-9b3e-66e88a7699a8 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:22.744108 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a9416d45-1958-461b-9b3e-66e88a7699a8 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:22.745076 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a9416d45-1958-461b-9b3e-66e88a7699a8 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:22.747057 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a9416d45-1958-461b-9b3e-66e88a7699a8 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:22.860487 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-cf9f7700-9c2e-484f-a81c-e984da4c51af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:22.861324 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-cf9f7700-9c2e-484f-a81c-e984da4c51af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:22.891523 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cf9f7700-9c2e-484f-a81c-e984da4c51af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:22.900007 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cf9f7700-9c2e-484f-a81c-e984da4c51af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:22.903157 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cf9f7700-9c2e-484f-a81c-e984da4c51af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:22.904571 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cf9f7700-9c2e-484f-a81c-e984da4c51af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:23.128077 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-a9416d45-1958-461b-9b3e-66e88a7699a8 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:23.140594 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-a9416d45-1958-461b-9b3e-66e88a7699a8 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1573 microversion: 2.1 time: 0.418607 Jun 15 14:50:23.143473 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 452/878] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:22 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1573 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:23.221743 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-cf9f7700-9c2e-484f-a81c-e984da4c51af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:23.231603 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-cf9f7700-9c2e-484f-a81c-e984da4c51af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:23.238242 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-cf9f7700-9c2e-484f-a81c-e984da4c51af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:23.242383 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-cf9f7700-9c2e-484f-a81c-e984da4c51af tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1736 microversion: 2.20 time: 0.388084 Jun 15 14:50:23.243247 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 427/879] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:22 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1736 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:50:24.162340 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e468aea7-2e0e-402d-a9be-30b688caa73f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:24.163549 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-e468aea7-2e0e-402d-a9be-30b688caa73f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:24.174605 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e468aea7-2e0e-402d-a9be-30b688caa73f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:24.175143 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e468aea7-2e0e-402d-a9be-30b688caa73f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:24.176014 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e468aea7-2e0e-402d-a9be-30b688caa73f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:24.177708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e468aea7-2e0e-402d-a9be-30b688caa73f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:24.263352 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6e019c8d-8bd6-40b3-bbae-a207a6219deb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:24.264163 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6e019c8d-8bd6-40b3-bbae-a207a6219deb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:24.276206 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6e019c8d-8bd6-40b3-bbae-a207a6219deb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:24.278141 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6e019c8d-8bd6-40b3-bbae-a207a6219deb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:24.280121 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6e019c8d-8bd6-40b3-bbae-a207a6219deb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:24.283584 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6e019c8d-8bd6-40b3-bbae-a207a6219deb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:24.591382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e468aea7-2e0e-402d-a9be-30b688caa73f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:24.606126 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-e468aea7-2e0e-402d-a9be-30b688caa73f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1573 microversion: 2.1 time: 0.448667 Jun 15 14:50:24.614021 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 453/880] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:24 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1573 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:24.619148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-c128a503-4849-4c91-8398-691a0dda04d3 req-fbcaa269-a6e9-40e9-9367-cce7794d85af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef2057b-c064-4900-a338-f86a4383746f", "tag": "a2b93273-5f17-40f1-81a6-00e33227d97a"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:24.636568 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-c128a503-4849-4c91-8398-691a0dda04d3 req-fbcaa269-a6e9-40e9-9367-cce7794d85af service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:24.637308 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-c128a503-4849-4c91-8398-691a0dda04d3 req-fbcaa269-a6e9-40e9-9367-cce7794d85af service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:24.669923 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-c128a503-4849-4c91-8398-691a0dda04d3 req-fbcaa269-a6e9-40e9-9367-cce7794d85af service nova] Creating event network-changed:a2b93273-5f17-40f1-81a6-00e33227d97a for instance 6ef2057b-c064-4900-a338-f86a4383746f on hv-cinder-84327 Jun 15 14:50:24.683571 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-c128a503-4849-4c91-8398-691a0dda04d3 req-fbcaa269-a6e9-40e9-9367-cce7794d85af service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067975 Jun 15 14:50:24.688931 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 454/881] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:24.689323 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6e019c8d-8bd6-40b3-bbae-a207a6219deb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:24.703546 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6e019c8d-8bd6-40b3-bbae-a207a6219deb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:24.710987 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6e019c8d-8bd6-40b3-bbae-a207a6219deb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:24.712504 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-6e019c8d-8bd6-40b3-bbae-a207a6219deb tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1736 microversion: 2.20 time: 0.453564 Jun 15 14:50:24.714233 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 428/882] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:24 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1736 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:50:24.923517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f8dfba6d-f571-41a0-9e59-a3a0d352218d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1753300030", "imageRef": "e18802bf-9dac-462c-88ba-5cce79043279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ffec14f9-f069-4e9d-93e1-f0addcf3eda2"}], "security_groups": [{"name": "tempest-securitygroup--2008217156"}], "key_name": "tempest-keypair-1273608603", "user_data": "}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:25.121572 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.network.neutron [None req-f8dfba6d-f571-41a0-9e59-a3a0d352218d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] validate_networks() for [('ffec14f9-f069-4e9d-93e1-f0addcf3eda2', None, None, None, None, None)] {{(pid=124219) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:50:25.623411 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-d2443f51-f546-4894-a969-2db4a51bdd69 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:25.625574 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-d2443f51-f546-4894-a969-2db4a51bdd69 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:25.638775 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d2443f51-f546-4894-a969-2db4a51bdd69 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:25.639240 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d2443f51-f546-4894-a969-2db4a51bdd69 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:25.644713 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d2443f51-f546-4894-a969-2db4a51bdd69 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:25.649818 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-d2443f51-f546-4894-a969-2db4a51bdd69 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:25.902482 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-d2443f51-f546-4894-a969-2db4a51bdd69 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:25.918113 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-d2443f51-f546-4894-a969-2db4a51bdd69 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1573 microversion: 2.1 time: 0.298209 Jun 15 14:50:25.919429 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 429/883] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:25 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1573 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:25.927224 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-fb789906-f6f7-40b5-bca7-43db79cef14b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:25.928142 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-fb789906-f6f7-40b5-bca7-43db79cef14b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:25.942027 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fb789906-f6f7-40b5-bca7-43db79cef14b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:25.943316 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fb789906-f6f7-40b5-bca7-43db79cef14b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:25.945007 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fb789906-f6f7-40b5-bca7-43db79cef14b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:25.946006 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fb789906-f6f7-40b5-bca7-43db79cef14b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:26.137197 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-fb789906-f6f7-40b5-bca7-43db79cef14b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:26.151436 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-fb789906-f6f7-40b5-bca7-43db79cef14b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:26.154412 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-fb789906-f6f7-40b5-bca7-43db79cef14b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:26.156170 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-fb789906-f6f7-40b5-bca7-43db79cef14b tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1736 microversion: 2.20 time: 0.234999 Jun 15 14:50:26.157707 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 430/884] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:25 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1736 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:26.266572 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-f8dfba6d-f571-41a0-9e59-a3a0d352218d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Flavor limits 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:50:26.267587 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-f8dfba6d-f571-41a0-9e59-a3a0d352218d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Image limits 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:50:26.268568 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-f8dfba6d-f571-41a0-9e59-a3a0d352218d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Flavor pref 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:50:26.269951 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-f8dfba6d-f571-41a0-9e59-a3a0d352218d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Image pref 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:50:26.270668 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-f8dfba6d-f571-41a0-9e59-a3a0d352218d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:50:26.284216 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f8dfba6d-f571-41a0-9e59-a3a0d352218d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:26.285194 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f8dfba6d-f571-41a0-9e59-a3a0d352218d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:26.286538 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f8dfba6d-f571-41a0-9e59-a3a0d352218d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:26.287229 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f8dfba6d-f571-41a0-9e59-a3a0d352218d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:26.313061 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-f8dfba6d-f571-41a0-9e59-a3a0d352218d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Getting quotas for project 591d111357224477998b265d45e3ee0d. Resources: {'cores', 'instances', 'ram'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:50:26.317262 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-f8dfba6d-f571-41a0-9e59-a3a0d352218d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Getting quotas for user 6caa64aecb914e968d057b6b593f667f and project 591d111357224477998b265d45e3ee0d. Resources: {'cores', 'instances', 'ram'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:50:26.331276 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f8dfba6d-f571-41a0-9e59-a3a0d352218d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Going to run 1 instances... {{(pid=124219) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:50:26.335427 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f8dfba6d-f571-41a0-9e59-a3a0d352218d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e18802bf-9dac-462c-88ba-5cce79043279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124219) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:50:26.401995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f8dfba6d-f571-41a0-9e59-a3a0d352218d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.483661 Jun 15 14:50:26.402963 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 455/885] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 14:50:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 1485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:50:26.414136 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1280b666-790e-4a0f-a551-b2a361497cb4 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:26.414755 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1280b666-790e-4a0f-a551-b2a361497cb4 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:26.482487 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-1280b666-790e-4a0f-a551-b2a361497cb4 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:26.497615 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-1280b666-790e-4a0f-a551-b2a361497cb4 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1242 microversion: 2.1 time: 0.087548 Jun 15 14:50:26.514370 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 431/886] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:26 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1242 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:26.938799 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e9e2d493-29f8-449b-8ea0-12c156b5b886 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:26.939716 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-e9e2d493-29f8-449b-8ea0-12c156b5b886 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:26.946605 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e9e2d493-29f8-449b-8ea0-12c156b5b886 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:26.947060 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e9e2d493-29f8-449b-8ea0-12c156b5b886 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:26.947834 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e9e2d493-29f8-449b-8ea0-12c156b5b886 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:26.948283 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e9e2d493-29f8-449b-8ea0-12c156b5b886 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:26.954699 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:27.136570 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e9e2d493-29f8-449b-8ea0-12c156b5b886 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:27.144343 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-e9e2d493-29f8-449b-8ea0-12c156b5b886 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1573 microversion: 2.1 time: 0.209896 Jun 15 14:50:27.144921 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 456/887] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:26 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1573 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:27.174806 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-b8408e9b-ddf8-463e-b58c-201b830732f6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:27.175450 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-b8408e9b-ddf8-463e-b58c-201b830732f6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:27.182722 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b8408e9b-ddf8-463e-b58c-201b830732f6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:27.183180 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b8408e9b-ddf8-463e-b58c-201b830732f6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:27.183939 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b8408e9b-ddf8-463e-b58c-201b830732f6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:27.184404 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b8408e9b-ddf8-463e-b58c-201b830732f6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:27.317804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-b8408e9b-ddf8-463e-b58c-201b830732f6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:27.327588 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-b8408e9b-ddf8-463e-b58c-201b830732f6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:27.329487 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-b8408e9b-ddf8-463e-b58c-201b830732f6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:27.331216 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-b8408e9b-ddf8-463e-b58c-201b830732f6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1718 microversion: 2.20 time: 0.160520 Jun 15 14:50:27.331693 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 432/888] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:27 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1718 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:27.516489 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-2386120b-64c3-4e05-a041-f3703ef4bd40 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:27.517016 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-2386120b-64c3-4e05-a041-f3703ef4bd40 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:27.523617 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2386120b-64c3-4e05-a041-f3703ef4bd40 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:27.524076 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2386120b-64c3-4e05-a041-f3703ef4bd40 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:27.524846 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2386120b-64c3-4e05-a041-f3703ef4bd40 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:27.525308 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2386120b-64c3-4e05-a041-f3703ef4bd40 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:27.594617 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-2386120b-64c3-4e05-a041-f3703ef4bd40 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:27.602435 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-2386120b-64c3-4e05-a041-f3703ef4bd40 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1294 microversion: 2.1 time: 0.090016 Jun 15 14:50:27.603012 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 457/889] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:27 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:28.162076 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a67bf668-f98c-41a3-ac80-fe0084113bf3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:28.162686 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a67bf668-f98c-41a3-ac80-fe0084113bf3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:28.168702 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a67bf668-f98c-41a3-ac80-fe0084113bf3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:28.169150 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a67bf668-f98c-41a3-ac80-fe0084113bf3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:28.169940 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a67bf668-f98c-41a3-ac80-fe0084113bf3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:28.170375 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a67bf668-f98c-41a3-ac80-fe0084113bf3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:28.298795 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a67bf668-f98c-41a3-ac80-fe0084113bf3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:28.306408 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a67bf668-f98c-41a3-ac80-fe0084113bf3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1573 microversion: 2.1 time: 0.148064 Jun 15 14:50:28.306913 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 433/890] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:28 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1573 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:28.349509 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f9b90ed7-de1c-4645-8351-fbe950187b72 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:28.350145 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f9b90ed7-de1c-4645-8351-fbe950187b72 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:28.357581 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f9b90ed7-de1c-4645-8351-fbe950187b72 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:28.358059 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f9b90ed7-de1c-4645-8351-fbe950187b72 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:28.358828 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f9b90ed7-de1c-4645-8351-fbe950187b72 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:28.359261 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f9b90ed7-de1c-4645-8351-fbe950187b72 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:28.490096 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f9b90ed7-de1c-4645-8351-fbe950187b72 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:28.497949 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f9b90ed7-de1c-4645-8351-fbe950187b72 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:28.499963 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f9b90ed7-de1c-4645-8351-fbe950187b72 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:28.501116 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f9b90ed7-de1c-4645-8351-fbe950187b72 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1718 microversion: 2.20 time: 0.155834 Jun 15 14:50:28.501680 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 458/891] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:28 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:28.620174 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-18f8ac72-b352-4635-906c-d28ae35a8ef5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:28.620788 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-18f8ac72-b352-4635-906c-d28ae35a8ef5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:28.627546 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-18f8ac72-b352-4635-906c-d28ae35a8ef5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:28.627997 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-18f8ac72-b352-4635-906c-d28ae35a8ef5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:28.628762 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-18f8ac72-b352-4635-906c-d28ae35a8ef5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:28.629198 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-18f8ac72-b352-4635-906c-d28ae35a8ef5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:28.692968 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-18f8ac72-b352-4635-906c-d28ae35a8ef5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:28.695271 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=100 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:28.702765 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-18f8ac72-b352-4635-906c-d28ae35a8ef5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1300 microversion: 2.1 time: 0.085904 Jun 15 14:50:28.703337 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 434/892] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:28 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:29.323823 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-7673fe6f-d786-4906-9738-ac3cfc1122f3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:29.324479 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-7673fe6f-d786-4906-9738-ac3cfc1122f3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:29.331928 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7673fe6f-d786-4906-9738-ac3cfc1122f3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:29.332379 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7673fe6f-d786-4906-9738-ac3cfc1122f3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:29.333137 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7673fe6f-d786-4906-9738-ac3cfc1122f3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:29.333574 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7673fe6f-d786-4906-9738-ac3cfc1122f3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:29.469057 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-7673fe6f-d786-4906-9738-ac3cfc1122f3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:29.476811 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-7673fe6f-d786-4906-9738-ac3cfc1122f3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1573 microversion: 2.1 time: 0.156879 Jun 15 14:50:29.477369 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 459/893] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:29 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:29.519179 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-eb67137b-a2c6-441b-80c7-a05b69b833d6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:29.519794 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-eb67137b-a2c6-441b-80c7-a05b69b833d6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:29.526547 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-eb67137b-a2c6-441b-80c7-a05b69b833d6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:29.526988 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-eb67137b-a2c6-441b-80c7-a05b69b833d6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:29.527746 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-eb67137b-a2c6-441b-80c7-a05b69b833d6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:29.528176 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-eb67137b-a2c6-441b-80c7-a05b69b833d6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:29.655975 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-eb67137b-a2c6-441b-80c7-a05b69b833d6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:29.663761 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-eb67137b-a2c6-441b-80c7-a05b69b833d6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:29.665254 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-eb67137b-a2c6-441b-80c7-a05b69b833d6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:29.666430 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-eb67137b-a2c6-441b-80c7-a05b69b833d6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1718 microversion: 2.20 time: 0.151215 Jun 15 14:50:29.666988 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 435/894] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:29 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:29.720524 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-9a1af4ff-f548-44f3-a108-ee4080812a7e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:29.721136 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-9a1af4ff-f548-44f3-a108-ee4080812a7e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:29.727403 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9a1af4ff-f548-44f3-a108-ee4080812a7e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:29.727853 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9a1af4ff-f548-44f3-a108-ee4080812a7e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:29.728607 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9a1af4ff-f548-44f3-a108-ee4080812a7e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:29.729132 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9a1af4ff-f548-44f3-a108-ee4080812a7e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:29.799271 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-9a1af4ff-f548-44f3-a108-ee4080812a7e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:29.806846 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-9a1af4ff-f548-44f3-a108-ee4080812a7e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1300 microversion: 2.1 time: 0.091186 Jun 15 14:50:29.807402 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 460/895] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:29 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:30.370248 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-b276e536-c282-49b6-ae46-b6a724dfbdda tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:30.370746 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-b276e536-c282-49b6-ae46-b6a724dfbdda tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:30.377003 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b276e536-c282-49b6-ae46-b6a724dfbdda tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:30.377547 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b276e536-c282-49b6-ae46-b6a724dfbdda tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:30.378453 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b276e536-c282-49b6-ae46-b6a724dfbdda tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:30.378956 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b276e536-c282-49b6-ae46-b6a724dfbdda tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:30.405549 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-b276e536-c282-49b6-ae46-b6a724dfbdda tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb/ips" status: 200 len: 146 microversion: 2.1 time: 0.039208 Jun 15 14:50:30.406640 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 436/896] 10.222.0.57 () {58 vars in 1247 bytes} [Wed Jun 15 14:50:30 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:30.495007 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-03d5f3b4-bcb1-4d80-b799-f87193ecc652 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:30.496186 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-03d5f3b4-bcb1-4d80-b799-f87193ecc652 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:30.503191 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-03d5f3b4-bcb1-4d80-b799-f87193ecc652 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:30.503647 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-03d5f3b4-bcb1-4d80-b799-f87193ecc652 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:30.504424 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-03d5f3b4-bcb1-4d80-b799-f87193ecc652 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:30.505025 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-03d5f3b4-bcb1-4d80-b799-f87193ecc652 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:30.684404 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c59d81b3-e6bb-40e6-939b-efcac267359e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:30.685049 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-c59d81b3-e6bb-40e6-939b-efcac267359e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:30.696733 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c59d81b3-e6bb-40e6-939b-efcac267359e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:30.699880 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c59d81b3-e6bb-40e6-939b-efcac267359e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:30.700919 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c59d81b3-e6bb-40e6-939b-efcac267359e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:30.703331 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c59d81b3-e6bb-40e6-939b-efcac267359e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:30.710390 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-03d5f3b4-bcb1-4d80-b799-f87193ecc652 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:30.720560 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-03d5f3b4-bcb1-4d80-b799-f87193ecc652 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1573 microversion: 2.1 time: 0.229483 Jun 15 14:50:30.722315 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 461/897] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:30 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1573 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:30.823798 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-168692cc-1601-4582-92cb-97dda7bd3bff tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:30.824441 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-168692cc-1601-4582-92cb-97dda7bd3bff tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:30.831719 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-168692cc-1601-4582-92cb-97dda7bd3bff tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:30.832170 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-168692cc-1601-4582-92cb-97dda7bd3bff tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:30.832937 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-168692cc-1601-4582-92cb-97dda7bd3bff tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:30.833373 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-168692cc-1601-4582-92cb-97dda7bd3bff tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:30.912906 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-168692cc-1601-4582-92cb-97dda7bd3bff tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:30.921734 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-168692cc-1601-4582-92cb-97dda7bd3bff tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1300 microversion: 2.1 time: 0.101327 Jun 15 14:50:30.931007 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 462/898] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:30 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1300 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:31.029148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-18a71406-3415-4ca9-b6d0-33f16c847104 req-750f1c02-5450-4a3e-b660-94ebeb0f9353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d0cbdc8-d87b-4ce4-97d1-59aca342287a", "name": "network-vif-unplugged", "status": "completed", "tag": "bf1963f9-4d7c-4562-9c53-6c53a728e8c6"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:31.038652 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-18a71406-3415-4ca9-b6d0-33f16c847104 req-750f1c02-5450-4a3e-b660-94ebeb0f9353 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:31.039395 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-18a71406-3415-4ca9-b6d0-33f16c847104 req-750f1c02-5450-4a3e-b660-94ebeb0f9353 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:31.053147 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-18a71406-3415-4ca9-b6d0-33f16c847104 req-750f1c02-5450-4a3e-b660-94ebeb0f9353 service nova] Creating event network-vif-unplugged:bf1963f9-4d7c-4562-9c53-6c53a728e8c6 for instance 7d0cbdc8-d87b-4ce4-97d1-59aca342287a on hv-cinder-84327 Jun 15 14:50:31.059273 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-18a71406-3415-4ca9-b6d0-33f16c847104 req-750f1c02-5450-4a3e-b660-94ebeb0f9353 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034068 Jun 15 14:50:31.060185 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 463/899] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:31.170480 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-c59d81b3-e6bb-40e6-939b-efcac267359e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:31.179523 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-c59d81b3-e6bb-40e6-939b-efcac267359e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:31.181206 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-c59d81b3-e6bb-40e6-939b-efcac267359e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:31.182415 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-c59d81b3-e6bb-40e6-939b-efcac267359e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1721 microversion: 2.20 time: 0.501839 Jun 15 14:50:31.182969 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 437/900] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:30 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1721 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:50:31.201823 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-47914f81-8804-4590-81bd-23466bf1a07c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "225bc7cd-4b07-49a5-8000-7260c303f68d"}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:31.203173 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-47914f81-8804-4590-81bd-23466bf1a07c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:31.209544 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-47914f81-8804-4590-81bd-23466bf1a07c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:31.210034 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-47914f81-8804-4590-81bd-23466bf1a07c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:31.210840 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-47914f81-8804-4590-81bd-23466bf1a07c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:31.211275 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-47914f81-8804-4590-81bd-23466bf1a07c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:31.554911 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-47914f81-8804-4590-81bd-23466bf1a07c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "POST /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.357426 Jun 15 14:50:31.555638 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 464/901] 10.222.0.57 () {62 vars in 1363 bytes} [Wed Jun 15 14:50:31 2022] POST /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a/os-volume_attachments => generated 188 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:50:31.679082 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a04702d7-aedb-4ef5-a971-fa88d29b723e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:31.679603 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a04702d7-aedb-4ef5-a971-fa88d29b723e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:31.685762 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a04702d7-aedb-4ef5-a971-fa88d29b723e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:31.686357 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a04702d7-aedb-4ef5-a971-fa88d29b723e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:31.687388 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a04702d7-aedb-4ef5-a971-fa88d29b723e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:31.687611 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a04702d7-aedb-4ef5-a971-fa88d29b723e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:31.740310 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-4f15b7ce-f3f5-4025-9d8e-8474ad2bb764 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:31.741261 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-4f15b7ce-f3f5-4025-9d8e-8474ad2bb764 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:31.748113 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4f15b7ce-f3f5-4025-9d8e-8474ad2bb764 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:31.748563 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4f15b7ce-f3f5-4025-9d8e-8474ad2bb764 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:31.749923 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4f15b7ce-f3f5-4025-9d8e-8474ad2bb764 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:31.750557 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4f15b7ce-f3f5-4025-9d8e-8474ad2bb764 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:31.895938 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-4f15b7ce-f3f5-4025-9d8e-8474ad2bb764 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:31.903883 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-4f15b7ce-f3f5-4025-9d8e-8474ad2bb764 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1573 microversion: 2.1 time: 0.167394 Jun 15 14:50:31.905793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 465/902] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:31 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1573 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:31.910664 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-193a1e68-0b6e-4195-83ae-d8940a4ea428 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2be37b48-ee79-45c2-b816-1d0388f6599f"}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:31.912005 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-193a1e68-0b6e-4195-83ae-d8940a4ea428 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:31.918343 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-193a1e68-0b6e-4195-83ae-d8940a4ea428 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:31.918793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-193a1e68-0b6e-4195-83ae-d8940a4ea428 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:31.919734 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-193a1e68-0b6e-4195-83ae-d8940a4ea428 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:31.920331 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-193a1e68-0b6e-4195-83ae-d8940a4ea428 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:32.001009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a04702d7-aedb-4ef5-a971-fa88d29b723e tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a/os-volume_attachments/225bc7cd-4b07-49a5-8000-7260c303f68d" status: 202 len: 0 microversion: 2.20 time: 0.325975 Jun 15 14:50:32.005605 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 438/903] 10.222.0.57 () {60 vars in 1456 bytes} [Wed Jun 15 14:50:31 2022] DELETE /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a/os-volume_attachments/225bc7cd-4b07-49a5-8000-7260c303f68d => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:50:32.013350 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-8e57404c-576c-470b-aa63-ba8a9e493b3a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:32.014013 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-8e57404c-576c-470b-aa63-ba8a9e493b3a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:32.038423 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8e57404c-576c-470b-aa63-ba8a9e493b3a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:32.039155 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8e57404c-576c-470b-aa63-ba8a9e493b3a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:32.043261 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8e57404c-576c-470b-aa63-ba8a9e493b3a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:32.043946 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8e57404c-576c-470b-aa63-ba8a9e493b3a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:32.396496 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-193a1e68-0b6e-4195-83ae-d8940a4ea428 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "POST /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.489459 Jun 15 14:50:32.397200 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 466/904] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 14:50:31 2022] POST /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb/os-volume_attachments => generated 194 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:32.403487 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-46ad5786-d6b9-41c8-8ff5-c2370edc6d00 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:32.404513 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-46ad5786-d6b9-41c8-8ff5-c2370edc6d00 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:32.411803 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-46ad5786-d6b9-41c8-8ff5-c2370edc6d00 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:32.412481 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-46ad5786-d6b9-41c8-8ff5-c2370edc6d00 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:32.413464 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-46ad5786-d6b9-41c8-8ff5-c2370edc6d00 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:32.413993 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-46ad5786-d6b9-41c8-8ff5-c2370edc6d00 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:32.500424 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-8e57404c-576c-470b-aa63-ba8a9e493b3a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:32.511350 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-8e57404c-576c-470b-aa63-ba8a9e493b3a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1368 microversion: 2.1 time: 0.504192 Jun 15 14:50:32.514365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 439/905] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:32 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1368 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:32.524890 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-c6395e05-0934-4ef1-b226-d2fe9caa0100 req-094e8275-3867-465a-b68b-ea5a23356a5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a97884f7-868c-4b2a-b518-feac560b9eff", "tag": "147f701a-dd9f-4cee-8def-a74eb3f0c1fd"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:32.535952 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-c6395e05-0934-4ef1-b226-d2fe9caa0100 req-094e8275-3867-465a-b68b-ea5a23356a5d service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:32.536724 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-c6395e05-0934-4ef1-b226-d2fe9caa0100 req-094e8275-3867-465a-b68b-ea5a23356a5d service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:32.538128 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-46ad5786-d6b9-41c8-8ff5-c2370edc6d00 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "POST /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a/action" status: 202 len: 0 microversion: 2.20 time: 0.139406 Jun 15 14:50:32.541949 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 467/906] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Jun 15 14:50:32 2022] POST /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:50:32.548088 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-d33b40b6-2fe0-4897-a173-145949723cd9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:32.548994 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-d33b40b6-2fe0-4897-a173-145949723cd9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:32.551380 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-c6395e05-0934-4ef1-b226-d2fe9caa0100 req-094e8275-3867-465a-b68b-ea5a23356a5d service nova] Creating event network-changed:147f701a-dd9f-4cee-8def-a74eb3f0c1fd for instance a97884f7-868c-4b2a-b518-feac560b9eff on hv-cinder-84327 Jun 15 14:50:32.555895 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d33b40b6-2fe0-4897-a173-145949723cd9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:32.557250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d33b40b6-2fe0-4897-a173-145949723cd9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:32.559152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-c6395e05-0934-4ef1-b226-d2fe9caa0100 req-094e8275-3867-465a-b68b-ea5a23356a5d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041957 Jun 15 14:50:32.560551 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 440/907] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:32.562457 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d33b40b6-2fe0-4897-a173-145949723cd9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:32.563390 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d33b40b6-2fe0-4897-a173-145949723cd9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:32.596815 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:32.737361 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d33b40b6-2fe0-4897-a173-145949723cd9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:32.746239 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d33b40b6-2fe0-4897-a173-145949723cd9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:32.747873 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d33b40b6-2fe0-4897-a173-145949723cd9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:32.749139 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-d33b40b6-2fe0-4897-a173-145949723cd9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1669 microversion: 2.20 time: 0.205903 Jun 15 14:50:32.749791 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 468/908] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:32 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1669 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:32.925432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-e833807b-3e5b-4c74-af11-a5ec64f49379 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:32.926692 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-e833807b-3e5b-4c74-af11-a5ec64f49379 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:32.937648 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e833807b-3e5b-4c74-af11-a5ec64f49379 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:32.939147 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e833807b-3e5b-4c74-af11-a5ec64f49379 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:32.941312 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e833807b-3e5b-4c74-af11-a5ec64f49379 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:32.942760 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e833807b-3e5b-4c74-af11-a5ec64f49379 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:33.104272 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e833807b-3e5b-4c74-af11-a5ec64f49379 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:33.113006 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-e833807b-3e5b-4c74-af11-a5ec64f49379 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1573 microversion: 2.1 time: 0.193951 Jun 15 14:50:33.113585 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 441/909] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:32 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1573 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:33.535353 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-826062ff-0c45-4291-97ce-3fe9d7a99a32 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:33.536091 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-826062ff-0c45-4291-97ce-3fe9d7a99a32 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:33.542644 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-826062ff-0c45-4291-97ce-3fe9d7a99a32 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:33.543090 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-826062ff-0c45-4291-97ce-3fe9d7a99a32 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:33.543842 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-826062ff-0c45-4291-97ce-3fe9d7a99a32 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:33.544277 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-826062ff-0c45-4291-97ce-3fe9d7a99a32 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:33.675755 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-826062ff-0c45-4291-97ce-3fe9d7a99a32 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:33.683488 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-826062ff-0c45-4291-97ce-3fe9d7a99a32 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1368 microversion: 2.1 time: 0.151885 Jun 15 14:50:33.684047 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 469/910] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:33 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:33.768580 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-fbb1faf1-2563-4925-b89c-a7a70c4183a7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:33.769191 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-fbb1faf1-2563-4925-b89c-a7a70c4183a7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:33.775238 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fbb1faf1-2563-4925-b89c-a7a70c4183a7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:33.775634 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fbb1faf1-2563-4925-b89c-a7a70c4183a7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:33.776396 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fbb1faf1-2563-4925-b89c-a7a70c4183a7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:33.776838 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fbb1faf1-2563-4925-b89c-a7a70c4183a7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:33.910061 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-fbb1faf1-2563-4925-b89c-a7a70c4183a7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:33.920874 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-fbb1faf1-2563-4925-b89c-a7a70c4183a7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:33.924342 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-fbb1faf1-2563-4925-b89c-a7a70c4183a7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:33.926485 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-fbb1faf1-2563-4925-b89c-a7a70c4183a7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1669 microversion: 2.20 time: 0.162244 Jun 15 14:50:33.927084 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 442/911] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:33 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:34.131559 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e0f75c92-bc33-416b-b44f-a9ecfb2b30ac tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:34.132191 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-e0f75c92-bc33-416b-b44f-a9ecfb2b30ac tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:34.135594 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:34.139360 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e0f75c92-bc33-416b-b44f-a9ecfb2b30ac tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:34.139814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e0f75c92-bc33-416b-b44f-a9ecfb2b30ac tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:34.140615 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e0f75c92-bc33-416b-b44f-a9ecfb2b30ac tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:34.141053 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e0f75c92-bc33-416b-b44f-a9ecfb2b30ac tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:34.274683 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e0f75c92-bc33-416b-b44f-a9ecfb2b30ac tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:34.284287 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-e0f75c92-bc33-416b-b44f-a9ecfb2b30ac tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1573 microversion: 2.1 time: 0.156519 Jun 15 14:50:34.293716 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 470/912] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:34 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:34.700939 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1737bd38-4f47-4403-9648-2c742b1c90da tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:34.701481 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1737bd38-4f47-4403-9648-2c742b1c90da tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:34.708646 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1737bd38-4f47-4403-9648-2c742b1c90da tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:34.709101 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1737bd38-4f47-4403-9648-2c742b1c90da tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:34.709905 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1737bd38-4f47-4403-9648-2c742b1c90da tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:34.710345 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1737bd38-4f47-4403-9648-2c742b1c90da tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:34.838436 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-1737bd38-4f47-4403-9648-2c742b1c90da tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:34.846777 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-1737bd38-4f47-4403-9648-2c742b1c90da tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1368 microversion: 2.1 time: 0.149719 Jun 15 14:50:34.847335 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 443/913] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:34 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:34.944354 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0f08cbe5-936f-4934-86c6-abfc5cc91009 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:34.945095 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-0f08cbe5-936f-4934-86c6-abfc5cc91009 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:34.951530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0f08cbe5-936f-4934-86c6-abfc5cc91009 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:34.951912 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0f08cbe5-936f-4934-86c6-abfc5cc91009 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:34.953603 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0f08cbe5-936f-4934-86c6-abfc5cc91009 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:34.954452 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0f08cbe5-936f-4934-86c6-abfc5cc91009 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:35.075583 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-dd3e08e7-1e8b-4f1e-a6af-d44077183f28 req-f6b127c3-76fe-4b91-8ca7-479dd0ac2f3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fdd6732-ba3a-4243-a57f-7e84f8eea531", "name": "network-vif-plugged", "status": "completed", "tag": "457c9267-d5cd-492d-9292-3d4518f9d2bb"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:35.089095 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-dd3e08e7-1e8b-4f1e-a6af-d44077183f28 req-f6b127c3-76fe-4b91-8ca7-479dd0ac2f3e service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:35.090358 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-dd3e08e7-1e8b-4f1e-a6af-d44077183f28 req-f6b127c3-76fe-4b91-8ca7-479dd0ac2f3e service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:35.126473 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-dd3e08e7-1e8b-4f1e-a6af-d44077183f28 req-f6b127c3-76fe-4b91-8ca7-479dd0ac2f3e service nova] Creating event network-vif-plugged:457c9267-d5cd-492d-9292-3d4518f9d2bb for instance 3fdd6732-ba3a-4243-a57f-7e84f8eea531 on hv-cinder-84327 Jun 15 14:50:35.135664 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-dd3e08e7-1e8b-4f1e-a6af-d44077183f28 req-f6b127c3-76fe-4b91-8ca7-479dd0ac2f3e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063416 Jun 15 14:50:35.137364 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 444/914] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:50:35.155079 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0f08cbe5-936f-4934-86c6-abfc5cc91009 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:35.167610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0f08cbe5-936f-4934-86c6-abfc5cc91009 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:35.169143 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-0f08cbe5-936f-4934-86c6-abfc5cc91009 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:35.170371 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-0f08cbe5-936f-4934-86c6-abfc5cc91009 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1727 microversion: 2.20 time: 0.229918 Jun 15 14:50:35.170998 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 471/915] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:34 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1727 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:35.301982 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-f7fb750b-43f1-4a92-80a6-3237ed38913b tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:35.302929 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-f7fb750b-43f1-4a92-80a6-3237ed38913b tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:35.309354 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f7fb750b-43f1-4a92-80a6-3237ed38913b tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:35.309916 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f7fb750b-43f1-4a92-80a6-3237ed38913b tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:35.310699 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f7fb750b-43f1-4a92-80a6-3237ed38913b tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:35.311139 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f7fb750b-43f1-4a92-80a6-3237ed38913b tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:35.462092 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-f7fb750b-43f1-4a92-80a6-3237ed38913b tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:35.470194 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-f7fb750b-43f1-4a92-80a6-3237ed38913b tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1573 microversion: 2.1 time: 0.171972 Jun 15 14:50:35.470781 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 445/916] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:35 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1573 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:35.864871 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-24165983-a832-4fbd-ad96-396d4b555a3e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:35.865593 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-24165983-a832-4fbd-ad96-396d4b555a3e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:35.871743 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-24165983-a832-4fbd-ad96-396d4b555a3e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:35.872221 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-24165983-a832-4fbd-ad96-396d4b555a3e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:35.872987 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-24165983-a832-4fbd-ad96-396d4b555a3e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:35.873425 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-24165983-a832-4fbd-ad96-396d4b555a3e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:36.068757 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-24165983-a832-4fbd-ad96-396d4b555a3e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:36.076903 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-24165983-a832-4fbd-ad96-396d4b555a3e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1368 microversion: 2.1 time: 0.215786 Jun 15 14:50:36.078640 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 472/917] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:35 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:36.190468 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-b2e87c60-e9fc-4401-93a6-76f041f6a3b6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:36.191082 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-b2e87c60-e9fc-4401-93a6-76f041f6a3b6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:36.197687 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b2e87c60-e9fc-4401-93a6-76f041f6a3b6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:36.198152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b2e87c60-e9fc-4401-93a6-76f041f6a3b6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:36.199353 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b2e87c60-e9fc-4401-93a6-76f041f6a3b6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:36.199353 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b2e87c60-e9fc-4401-93a6-76f041f6a3b6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:36.329082 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-b2e87c60-e9fc-4401-93a6-76f041f6a3b6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:36.337040 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-b2e87c60-e9fc-4401-93a6-76f041f6a3b6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:36.338572 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-b2e87c60-e9fc-4401-93a6-76f041f6a3b6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:36.339722 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-b2e87c60-e9fc-4401-93a6-76f041f6a3b6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1727 microversion: 2.20 time: 0.154144 Jun 15 14:50:36.340293 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 446/918] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:36 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:36.488830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-51656f07-5898-4899-9ad9-11746b16687b tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:36.489593 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-51656f07-5898-4899-9ad9-11746b16687b tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:36.491991 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=2 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:36.492665 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=6 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:36.499545 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-51656f07-5898-4899-9ad9-11746b16687b tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:36.500007 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-51656f07-5898-4899-9ad9-11746b16687b tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:36.500921 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-51656f07-5898-4899-9ad9-11746b16687b tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:36.501359 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-51656f07-5898-4899-9ad9-11746b16687b tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:36.633237 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-51656f07-5898-4899-9ad9-11746b16687b tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:36.641389 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-51656f07-5898-4899-9ad9-11746b16687b tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1573 microversion: 2.1 time: 0.157858 Jun 15 14:50:36.641984 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 473/919] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:36 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:37.102075 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-f1743988-8763-4dd6-9c96-1848a0c3c7fb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:37.112024 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-f1743988-8763-4dd6-9c96-1848a0c3c7fb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:37.115929 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=6 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:37.127894 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f1743988-8763-4dd6-9c96-1848a0c3c7fb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:37.129140 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f1743988-8763-4dd6-9c96-1848a0c3c7fb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:37.130174 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f1743988-8763-4dd6-9c96-1848a0c3c7fb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:37.131135 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f1743988-8763-4dd6-9c96-1848a0c3c7fb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:37.283693 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-f1743988-8763-4dd6-9c96-1848a0c3c7fb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:37.291115 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-f1743988-8763-4dd6-9c96-1848a0c3c7fb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1368 microversion: 2.1 time: 0.200625 Jun 15 14:50:37.291676 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 447/920] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:37 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1368 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:37.358716 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-21a86328-3db2-4c93-8fdc-2cff959312da tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:37.359246 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-21a86328-3db2-4c93-8fdc-2cff959312da tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:37.365259 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-21a86328-3db2-4c93-8fdc-2cff959312da tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:37.365742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-21a86328-3db2-4c93-8fdc-2cff959312da tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:37.366514 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-21a86328-3db2-4c93-8fdc-2cff959312da tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:37.366952 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-21a86328-3db2-4c93-8fdc-2cff959312da tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:37.520814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-21a86328-3db2-4c93-8fdc-2cff959312da tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:37.528812 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-21a86328-3db2-4c93-8fdc-2cff959312da tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:37.530849 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-21a86328-3db2-4c93-8fdc-2cff959312da tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:37.532242 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-21a86328-3db2-4c93-8fdc-2cff959312da tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1727 microversion: 2.20 time: 0.177562 Jun 15 14:50:37.532806 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 474/921] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:37 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:37.659392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-727ad632-e2da-4e71-9c68-07e07e8a3f38 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:37.660713 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-727ad632-e2da-4e71-9c68-07e07e8a3f38 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:37.666334 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-727ad632-e2da-4e71-9c68-07e07e8a3f38 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:37.666875 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-727ad632-e2da-4e71-9c68-07e07e8a3f38 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:37.667583 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-727ad632-e2da-4e71-9c68-07e07e8a3f38 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:37.668034 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-727ad632-e2da-4e71-9c68-07e07e8a3f38 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:37.839922 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-727ad632-e2da-4e71-9c68-07e07e8a3f38 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:37.848565 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-727ad632-e2da-4e71-9c68-07e07e8a3f38 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1573 microversion: 2.1 time: 0.193760 Jun 15 14:50:37.849135 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 448/922] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:37 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1573 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:38.311394 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-1bb6e54b-bd7d-40dd-a768-7f528a81b112 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:38.313305 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-1bb6e54b-bd7d-40dd-a768-7f528a81b112 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:38.320018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1bb6e54b-bd7d-40dd-a768-7f528a81b112 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:38.320467 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1bb6e54b-bd7d-40dd-a768-7f528a81b112 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:38.321482 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1bb6e54b-bd7d-40dd-a768-7f528a81b112 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:38.322096 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1bb6e54b-bd7d-40dd-a768-7f528a81b112 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:38.491153 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-1bb6e54b-bd7d-40dd-a768-7f528a81b112 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:38.499434 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-1bb6e54b-bd7d-40dd-a768-7f528a81b112 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1368 microversion: 2.1 time: 0.194613 Jun 15 14:50:38.500135 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 475/923] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:38 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:38.550514 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-719e5264-0d51-4ceb-b271-8156560a0202 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:38.551219 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-719e5264-0d51-4ceb-b271-8156560a0202 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:38.558001 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-719e5264-0d51-4ceb-b271-8156560a0202 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:38.558526 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-719e5264-0d51-4ceb-b271-8156560a0202 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:38.559373 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-719e5264-0d51-4ceb-b271-8156560a0202 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:38.559902 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-719e5264-0d51-4ceb-b271-8156560a0202 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:38.711658 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-719e5264-0d51-4ceb-b271-8156560a0202 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:38.719599 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-719e5264-0d51-4ceb-b271-8156560a0202 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:38.721102 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-719e5264-0d51-4ceb-b271-8156560a0202 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:38.722306 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-719e5264-0d51-4ceb-b271-8156560a0202 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1727 microversion: 2.20 time: 0.175708 Jun 15 14:50:38.722865 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 449/924] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:38 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:38.865989 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-bc9096b2-f559-4914-baa7-f60fd16e4224 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:38.866616 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-bc9096b2-f559-4914-baa7-f60fd16e4224 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:38.873028 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bc9096b2-f559-4914-baa7-f60fd16e4224 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:38.873471 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bc9096b2-f559-4914-baa7-f60fd16e4224 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:38.874979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bc9096b2-f559-4914-baa7-f60fd16e4224 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:38.875515 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bc9096b2-f559-4914-baa7-f60fd16e4224 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:39.038258 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-bc9096b2-f559-4914-baa7-f60fd16e4224 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:39.048731 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-bc9096b2-f559-4914-baa7-f60fd16e4224 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1573 microversion: 2.1 time: 0.186381 Jun 15 14:50:39.049318 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 476/925] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:38 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1573 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:39.114828 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-c0781065-7546-4f90-adce-d35606d950e3 req-e25be2e5-d0a1-4cd2-85d0-76400a2e7779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97884f7-868c-4b2a-b518-feac560b9eff", "name": "network-vif-plugged", "status": "completed", "tag": "147f701a-dd9f-4cee-8def-a74eb3f0c1fd"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:39.141481 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-c0781065-7546-4f90-adce-d35606d950e3 req-e25be2e5-d0a1-4cd2-85d0-76400a2e7779 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:39.142123 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-c0781065-7546-4f90-adce-d35606d950e3 req-e25be2e5-d0a1-4cd2-85d0-76400a2e7779 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:39.154203 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-c0781065-7546-4f90-adce-d35606d950e3 req-e25be2e5-d0a1-4cd2-85d0-76400a2e7779 service nova] Creating event network-vif-plugged:147f701a-dd9f-4cee-8def-a74eb3f0c1fd for instance a97884f7-868c-4b2a-b518-feac560b9eff on hv-cinder-84327 Jun 15 14:50:39.160209 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-c0781065-7546-4f90-adce-d35606d950e3 req-e25be2e5-d0a1-4cd2-85d0-76400a2e7779 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051816 Jun 15 14:50:39.160895 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 450/926] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:39.517181 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c9f98b47-0b18-4dff-8314-62d441bb61bc tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:39.517834 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c9f98b47-0b18-4dff-8314-62d441bb61bc tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:39.524240 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c9f98b47-0b18-4dff-8314-62d441bb61bc tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:39.524704 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c9f98b47-0b18-4dff-8314-62d441bb61bc tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:39.526006 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c9f98b47-0b18-4dff-8314-62d441bb61bc tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:39.526669 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c9f98b47-0b18-4dff-8314-62d441bb61bc tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:39.671588 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c9f98b47-0b18-4dff-8314-62d441bb61bc tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:39.680264 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-c9f98b47-0b18-4dff-8314-62d441bb61bc tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1368 microversion: 2.1 time: 0.167701 Jun 15 14:50:39.680875 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 477/927] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:39 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:39.741040 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-ce91a6e2-73af-4539-bfc5-e6665d83426f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:39.741688 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-ce91a6e2-73af-4539-bfc5-e6665d83426f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:39.748392 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ce91a6e2-73af-4539-bfc5-e6665d83426f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:39.748838 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ce91a6e2-73af-4539-bfc5-e6665d83426f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:39.750226 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ce91a6e2-73af-4539-bfc5-e6665d83426f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:39.750650 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ce91a6e2-73af-4539-bfc5-e6665d83426f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:39.754705 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:39.902410 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ce91a6e2-73af-4539-bfc5-e6665d83426f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:39.929765 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ce91a6e2-73af-4539-bfc5-e6665d83426f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:39.931848 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ce91a6e2-73af-4539-bfc5-e6665d83426f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:39.933167 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-ce91a6e2-73af-4539-bfc5-e6665d83426f tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1727 microversion: 2.20 time: 0.196471 Jun 15 14:50:39.944518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 451/928] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:39 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1727 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:40.067383 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-2785a863-196e-49ee-b474-764bc1d1e9c4 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:40.067991 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-2785a863-196e-49ee-b474-764bc1d1e9c4 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:40.074256 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2785a863-196e-49ee-b474-764bc1d1e9c4 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:40.074692 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2785a863-196e-49ee-b474-764bc1d1e9c4 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:40.075456 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2785a863-196e-49ee-b474-764bc1d1e9c4 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:40.075890 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2785a863-196e-49ee-b474-764bc1d1e9c4 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:40.212361 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-2785a863-196e-49ee-b474-764bc1d1e9c4 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:40.221091 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-2785a863-196e-49ee-b474-764bc1d1e9c4 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1573 microversion: 2.1 time: 0.157766 Jun 15 14:50:40.221845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 478/929] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:40 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:40.697762 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-52c5a147-5c96-4eb9-b6f1-dee57c4cdf2e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:40.698473 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-52c5a147-5c96-4eb9-b6f1-dee57c4cdf2e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:40.706844 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-52c5a147-5c96-4eb9-b6f1-dee57c4cdf2e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:40.707238 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-52c5a147-5c96-4eb9-b6f1-dee57c4cdf2e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:40.708030 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-52c5a147-5c96-4eb9-b6f1-dee57c4cdf2e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:40.708477 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-52c5a147-5c96-4eb9-b6f1-dee57c4cdf2e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:40.855028 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-52c5a147-5c96-4eb9-b6f1-dee57c4cdf2e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:40.862871 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-52c5a147-5c96-4eb9-b6f1-dee57c4cdf2e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1368 microversion: 2.1 time: 0.168926 Jun 15 14:50:40.870516 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 452/930] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:40 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:40.951752 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-a6295788-783c-4dd6-ac9f-27c09d12ef68 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:40.952979 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-a6295788-783c-4dd6-ac9f-27c09d12ef68 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:40.959659 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a6295788-783c-4dd6-ac9f-27c09d12ef68 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:40.960046 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a6295788-783c-4dd6-ac9f-27c09d12ef68 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:40.960814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a6295788-783c-4dd6-ac9f-27c09d12ef68 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:40.961250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a6295788-783c-4dd6-ac9f-27c09d12ef68 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:41.098319 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-a6295788-783c-4dd6-ac9f-27c09d12ef68 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:41.107630 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-a6295788-783c-4dd6-ac9f-27c09d12ef68 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:41.109691 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-a6295788-783c-4dd6-ac9f-27c09d12ef68 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:41.111270 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-a6295788-783c-4dd6-ac9f-27c09d12ef68 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1727 microversion: 2.20 time: 0.163413 Jun 15 14:50:41.124783 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 479/931] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:40 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:41.239753 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-05b46807-c828-414b-80ce-6c55d3778527 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:41.240314 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-05b46807-c828-414b-80ce-6c55d3778527 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:41.246536 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-05b46807-c828-414b-80ce-6c55d3778527 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:41.246990 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-05b46807-c828-414b-80ce-6c55d3778527 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:41.247805 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-05b46807-c828-414b-80ce-6c55d3778527 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:41.248245 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-05b46807-c828-414b-80ce-6c55d3778527 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:41.384340 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-05b46807-c828-414b-80ce-6c55d3778527 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:41.392743 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-05b46807-c828-414b-80ce-6c55d3778527 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1573 microversion: 2.1 time: 0.157203 Jun 15 14:50:41.393315 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 453/932] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:41 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:41.881087 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-787d0e57-326b-42a8-a68a-83c377f445cb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:41.882330 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-787d0e57-326b-42a8-a68a-83c377f445cb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:41.889941 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-787d0e57-326b-42a8-a68a-83c377f445cb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:41.891254 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-787d0e57-326b-42a8-a68a-83c377f445cb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:41.892679 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-787d0e57-326b-42a8-a68a-83c377f445cb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:41.893352 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-787d0e57-326b-42a8-a68a-83c377f445cb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:42.031773 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-787d0e57-326b-42a8-a68a-83c377f445cb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:42.040493 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-787d0e57-326b-42a8-a68a-83c377f445cb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1368 microversion: 2.1 time: 0.163937 Jun 15 14:50:42.041467 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 480/933] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:41 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:42.131468 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1e4111dd-b044-45d5-b4f9-bdfbaee50c58 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:42.132155 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1e4111dd-b044-45d5-b4f9-bdfbaee50c58 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:42.134556 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:42.140398 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1e4111dd-b044-45d5-b4f9-bdfbaee50c58 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:42.140998 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1e4111dd-b044-45d5-b4f9-bdfbaee50c58 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:42.141873 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1e4111dd-b044-45d5-b4f9-bdfbaee50c58 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:42.142408 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1e4111dd-b044-45d5-b4f9-bdfbaee50c58 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:42.287719 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-1e4111dd-b044-45d5-b4f9-bdfbaee50c58 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:42.296824 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-1e4111dd-b044-45d5-b4f9-bdfbaee50c58 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:42.298681 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-1e4111dd-b044-45d5-b4f9-bdfbaee50c58 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:42.299874 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-1e4111dd-b044-45d5-b4f9-bdfbaee50c58 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1727 microversion: 2.20 time: 0.172292 Jun 15 14:50:42.310247 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 454/934] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:42 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:42.410398 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3b84061d-0924-4554-8f83-8e68bbc8d4a0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:42.411016 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-3b84061d-0924-4554-8f83-8e68bbc8d4a0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:42.417353 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3b84061d-0924-4554-8f83-8e68bbc8d4a0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:42.417833 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3b84061d-0924-4554-8f83-8e68bbc8d4a0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:42.418704 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3b84061d-0924-4554-8f83-8e68bbc8d4a0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:42.419146 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3b84061d-0924-4554-8f83-8e68bbc8d4a0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:42.575517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-3b84061d-0924-4554-8f83-8e68bbc8d4a0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:42.584116 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-3b84061d-0924-4554-8f83-8e68bbc8d4a0 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1573 microversion: 2.1 time: 0.178270 Jun 15 14:50:42.584692 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 481/935] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:42 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1573 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:43.060183 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-5edcaafe-8735-4d1c-8fe0-ba9169121fd0 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:43.061574 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-5edcaafe-8735-4d1c-8fe0-ba9169121fd0 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:43.076068 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5edcaafe-8735-4d1c-8fe0-ba9169121fd0 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:43.076697 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5edcaafe-8735-4d1c-8fe0-ba9169121fd0 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:43.090067 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5edcaafe-8735-4d1c-8fe0-ba9169121fd0 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:43.090067 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5edcaafe-8735-4d1c-8fe0-ba9169121fd0 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:43.235550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-5edcaafe-8735-4d1c-8fe0-ba9169121fd0 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:43.243132 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-5edcaafe-8735-4d1c-8fe0-ba9169121fd0 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1368 microversion: 2.1 time: 0.188044 Jun 15 14:50:43.243688 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 455/936] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:43 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:43.318158 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-a1a10876-98ae-463a-b2b3-95b580fd00e9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:43.319343 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-a1a10876-98ae-463a-b2b3-95b580fd00e9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:43.327177 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a1a10876-98ae-463a-b2b3-95b580fd00e9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:43.327916 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a1a10876-98ae-463a-b2b3-95b580fd00e9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:43.328883 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a1a10876-98ae-463a-b2b3-95b580fd00e9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:43.329321 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a1a10876-98ae-463a-b2b3-95b580fd00e9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:43.471355 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-a1a10876-98ae-463a-b2b3-95b580fd00e9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:43.479577 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-a1a10876-98ae-463a-b2b3-95b580fd00e9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:43.481087 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-a1a10876-98ae-463a-b2b3-95b580fd00e9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:43.482290 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-a1a10876-98ae-463a-b2b3-95b580fd00e9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1727 microversion: 2.20 time: 0.168313 Jun 15 14:50:43.482838 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 482/937] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:43 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:43.601527 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-fb207425-b117-4299-b97d-ffae83c2a964 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:43.602287 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-fb207425-b117-4299-b97d-ffae83c2a964 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:43.608847 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fb207425-b117-4299-b97d-ffae83c2a964 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:43.609255 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fb207425-b117-4299-b97d-ffae83c2a964 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:43.610389 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fb207425-b117-4299-b97d-ffae83c2a964 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:43.610860 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fb207425-b117-4299-b97d-ffae83c2a964 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:43.747549 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-fb207425-b117-4299-b97d-ffae83c2a964 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:43.755537 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-fb207425-b117-4299-b97d-ffae83c2a964 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1573 microversion: 2.1 time: 0.158092 Jun 15 14:50:43.757901 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 456/938] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:43 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:44.260197 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-68f4e692-203c-41f3-aac8-0264531a10b1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:44.260835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-68f4e692-203c-41f3-aac8-0264531a10b1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:44.267896 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-68f4e692-203c-41f3-aac8-0264531a10b1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:44.268349 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-68f4e692-203c-41f3-aac8-0264531a10b1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:44.269112 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-68f4e692-203c-41f3-aac8-0264531a10b1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:44.269549 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-68f4e692-203c-41f3-aac8-0264531a10b1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:44.404770 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-68f4e692-203c-41f3-aac8-0264531a10b1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:44.412306 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-68f4e692-203c-41f3-aac8-0264531a10b1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1368 microversion: 2.1 time: 0.156009 Jun 15 14:50:44.412864 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 483/939] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:44 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:44.505176 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a2a3bac3-2398-4232-812a-5fe14b3ac09a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:44.507615 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a2a3bac3-2398-4232-812a-5fe14b3ac09a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:44.516211 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a2a3bac3-2398-4232-812a-5fe14b3ac09a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:44.516809 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a2a3bac3-2398-4232-812a-5fe14b3ac09a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:44.517771 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a2a3bac3-2398-4232-812a-5fe14b3ac09a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:44.518456 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a2a3bac3-2398-4232-812a-5fe14b3ac09a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:44.659559 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a2a3bac3-2398-4232-812a-5fe14b3ac09a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:44.667762 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a2a3bac3-2398-4232-812a-5fe14b3ac09a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:44.669264 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a2a3bac3-2398-4232-812a-5fe14b3ac09a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:44.670466 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a2a3bac3-2398-4232-812a-5fe14b3ac09a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1727 microversion: 2.20 time: 0.172408 Jun 15 14:50:44.671030 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 457/940] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:44 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:44.775232 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-7e346e0e-841f-4afc-b998-5134d7a6f58c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:44.776196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-7e346e0e-841f-4afc-b998-5134d7a6f58c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:44.785379 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7e346e0e-841f-4afc-b998-5134d7a6f58c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:44.786209 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7e346e0e-841f-4afc-b998-5134d7a6f58c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:44.787545 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7e346e0e-841f-4afc-b998-5134d7a6f58c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:44.788216 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7e346e0e-841f-4afc-b998-5134d7a6f58c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:44.926954 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-7e346e0e-841f-4afc-b998-5134d7a6f58c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:44.934504 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-7e346e0e-841f-4afc-b998-5134d7a6f58c tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1573 microversion: 2.1 time: 0.164492 Jun 15 14:50:44.935113 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 484/941] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:44 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:45.433419 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-862f246f-161d-4de8-bf0e-019ea815e681 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:45.434460 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-862f246f-161d-4de8-bf0e-019ea815e681 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:45.441767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-862f246f-161d-4de8-bf0e-019ea815e681 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:45.442221 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-862f246f-161d-4de8-bf0e-019ea815e681 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:45.442996 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-862f246f-161d-4de8-bf0e-019ea815e681 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:45.443581 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-862f246f-161d-4de8-bf0e-019ea815e681 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:45.586674 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-862f246f-161d-4de8-bf0e-019ea815e681 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:45.596251 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-862f246f-161d-4de8-bf0e-019ea815e681 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1368 microversion: 2.1 time: 0.169121 Jun 15 14:50:45.597006 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 458/942] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:45 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:45.689303 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-675b9a88-d0d9-462b-a587-0b53aa9c1cfe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:45.690108 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-675b9a88-d0d9-462b-a587-0b53aa9c1cfe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:45.706827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-675b9a88-d0d9-462b-a587-0b53aa9c1cfe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:45.707821 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-675b9a88-d0d9-462b-a587-0b53aa9c1cfe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:45.708866 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-675b9a88-d0d9-462b-a587-0b53aa9c1cfe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:45.709529 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-675b9a88-d0d9-462b-a587-0b53aa9c1cfe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:45.715830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=100 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:45.850602 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-675b9a88-d0d9-462b-a587-0b53aa9c1cfe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:45.860268 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-675b9a88-d0d9-462b-a587-0b53aa9c1cfe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:45.861809 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-675b9a88-d0d9-462b-a587-0b53aa9c1cfe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:45.863163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-675b9a88-d0d9-462b-a587-0b53aa9c1cfe tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1727 microversion: 2.20 time: 0.178013 Jun 15 14:50:45.869493 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 485/943] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:45 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:45.952189 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-8354afe7-c069-4a57-b430-ba88830b9c9d tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:45.953482 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-8354afe7-c069-4a57-b430-ba88830b9c9d tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:45.960171 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8354afe7-c069-4a57-b430-ba88830b9c9d tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:45.960693 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8354afe7-c069-4a57-b430-ba88830b9c9d tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:45.961637 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8354afe7-c069-4a57-b430-ba88830b9c9d tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:45.962212 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8354afe7-c069-4a57-b430-ba88830b9c9d tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:46.102365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-8354afe7-c069-4a57-b430-ba88830b9c9d tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:46.110988 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-8354afe7-c069-4a57-b430-ba88830b9c9d tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1573 microversion: 2.1 time: 0.162689 Jun 15 14:50:46.111967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 459/944] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:45 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1573 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:46.614462 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-96f6631e-0b10-4da0-bd89-05ea3ff185b5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:46.615117 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-96f6631e-0b10-4da0-bd89-05ea3ff185b5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:46.621409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-96f6631e-0b10-4da0-bd89-05ea3ff185b5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:46.621916 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-96f6631e-0b10-4da0-bd89-05ea3ff185b5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:46.622690 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-96f6631e-0b10-4da0-bd89-05ea3ff185b5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:46.623160 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-96f6631e-0b10-4da0-bd89-05ea3ff185b5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:46.762115 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-96f6631e-0b10-4da0-bd89-05ea3ff185b5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:46.769825 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-96f6631e-0b10-4da0-bd89-05ea3ff185b5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1368 microversion: 2.1 time: 0.159982 Jun 15 14:50:46.770412 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 486/945] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:46 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:46.881612 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-71d87243-4028-4a83-8612-74d17e7932d2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:46.882181 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-71d87243-4028-4a83-8612-74d17e7932d2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:46.888818 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-71d87243-4028-4a83-8612-74d17e7932d2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:46.889265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-71d87243-4028-4a83-8612-74d17e7932d2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:46.890054 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-71d87243-4028-4a83-8612-74d17e7932d2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:46.890493 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-71d87243-4028-4a83-8612-74d17e7932d2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:47.031985 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-71d87243-4028-4a83-8612-74d17e7932d2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:47.040749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-71d87243-4028-4a83-8612-74d17e7932d2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:47.042356 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-71d87243-4028-4a83-8612-74d17e7932d2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:47.043523 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-71d87243-4028-4a83-8612-74d17e7932d2 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1727 microversion: 2.20 time: 0.166998 Jun 15 14:50:47.044087 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 460/946] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:46 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:47.128085 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-b1e37514-42cd-45a7-9ed2-7afbd640e142 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:47.128688 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-b1e37514-42cd-45a7-9ed2-7afbd640e142 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:47.134769 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b1e37514-42cd-45a7-9ed2-7afbd640e142 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:47.135156 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b1e37514-42cd-45a7-9ed2-7afbd640e142 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:47.135909 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b1e37514-42cd-45a7-9ed2-7afbd640e142 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:47.136341 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b1e37514-42cd-45a7-9ed2-7afbd640e142 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:47.274590 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b1e37514-42cd-45a7-9ed2-7afbd640e142 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:47.282046 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-b1e37514-42cd-45a7-9ed2-7afbd640e142 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1573 microversion: 2.1 time: 0.158043 Jun 15 14:50:47.285290 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 487/947] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:47 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:47.787087 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-29cf4bd0-7f2c-4d90-ab10-8f9460a34954 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:47.787699 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-29cf4bd0-7f2c-4d90-ab10-8f9460a34954 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:47.793957 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-29cf4bd0-7f2c-4d90-ab10-8f9460a34954 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:47.794414 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-29cf4bd0-7f2c-4d90-ab10-8f9460a34954 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:47.795191 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-29cf4bd0-7f2c-4d90-ab10-8f9460a34954 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:47.795631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-29cf4bd0-7f2c-4d90-ab10-8f9460a34954 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:47.927471 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-29cf4bd0-7f2c-4d90-ab10-8f9460a34954 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:47.934833 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-29cf4bd0-7f2c-4d90-ab10-8f9460a34954 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1368 microversion: 2.1 time: 0.152048 Jun 15 14:50:47.935400 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 461/948] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:47 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:48.063203 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-8071dbb2-8cb5-4efe-a163-dd5cedca8df0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:48.063787 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-8071dbb2-8cb5-4efe-a163-dd5cedca8df0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:48.072038 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8071dbb2-8cb5-4efe-a163-dd5cedca8df0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:48.072481 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8071dbb2-8cb5-4efe-a163-dd5cedca8df0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:48.073443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8071dbb2-8cb5-4efe-a163-dd5cedca8df0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:48.073915 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8071dbb2-8cb5-4efe-a163-dd5cedca8df0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:48.208227 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-8071dbb2-8cb5-4efe-a163-dd5cedca8df0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:48.216107 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-8071dbb2-8cb5-4efe-a163-dd5cedca8df0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:48.217606 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-8071dbb2-8cb5-4efe-a163-dd5cedca8df0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:48.218793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-8071dbb2-8cb5-4efe-a163-dd5cedca8df0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1727 microversion: 2.20 time: 0.159603 Jun 15 14:50:48.219354 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 488/949] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:48 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:48.301194 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-e7222b9c-8613-457b-8f0d-4b67cf06c0fd tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:48.301842 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-e7222b9c-8613-457b-8f0d-4b67cf06c0fd tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:48.307816 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e7222b9c-8613-457b-8f0d-4b67cf06c0fd tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:48.308270 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e7222b9c-8613-457b-8f0d-4b67cf06c0fd tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:48.309035 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e7222b9c-8613-457b-8f0d-4b67cf06c0fd tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:48.309474 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e7222b9c-8613-457b-8f0d-4b67cf06c0fd tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:48.484528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e7222b9c-8613-457b-8f0d-4b67cf06c0fd tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:48.494496 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-e7222b9c-8613-457b-8f0d-4b67cf06c0fd tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1573 microversion: 2.1 time: 0.197667 Jun 15 14:50:48.496655 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 462/950] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:48 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1573 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:48.952572 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f9d8b5e1-a6cb-42b8-9235-5f1fdacb31ad tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:48.953309 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f9d8b5e1-a6cb-42b8-9235-5f1fdacb31ad tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:48.960145 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f9d8b5e1-a6cb-42b8-9235-5f1fdacb31ad tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:48.960599 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f9d8b5e1-a6cb-42b8-9235-5f1fdacb31ad tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:48.961371 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f9d8b5e1-a6cb-42b8-9235-5f1fdacb31ad tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:48.961847 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f9d8b5e1-a6cb-42b8-9235-5f1fdacb31ad tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:49.098450 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f9d8b5e1-a6cb-42b8-9235-5f1fdacb31ad tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:49.106220 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f9d8b5e1-a6cb-42b8-9235-5f1fdacb31ad tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1368 microversion: 2.1 time: 0.157686 Jun 15 14:50:49.106777 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 489/951] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:48 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:49.236244 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-ab9b8bc6-1a5f-4352-b086-1fe47020fbf0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:49.236859 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-ab9b8bc6-1a5f-4352-b086-1fe47020fbf0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:49.243673 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ab9b8bc6-1a5f-4352-b086-1fe47020fbf0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:49.244119 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ab9b8bc6-1a5f-4352-b086-1fe47020fbf0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:49.244879 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ab9b8bc6-1a5f-4352-b086-1fe47020fbf0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:49.245311 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ab9b8bc6-1a5f-4352-b086-1fe47020fbf0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:49.378071 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ab9b8bc6-1a5f-4352-b086-1fe47020fbf0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:49.386101 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ab9b8bc6-1a5f-4352-b086-1fe47020fbf0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:49.387608 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ab9b8bc6-1a5f-4352-b086-1fe47020fbf0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:49.388782 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-ab9b8bc6-1a5f-4352-b086-1fe47020fbf0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1727 microversion: 2.20 time: 0.156405 Jun 15 14:50:49.389334 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 463/952] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:49 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:49.511324 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c132a2d0-de86-4e03-b7a0-328980abda19 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:49.511942 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c132a2d0-de86-4e03-b7a0-328980abda19 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:49.518833 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c132a2d0-de86-4e03-b7a0-328980abda19 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:49.519281 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c132a2d0-de86-4e03-b7a0-328980abda19 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:49.520047 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c132a2d0-de86-4e03-b7a0-328980abda19 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:49.520484 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c132a2d0-de86-4e03-b7a0-328980abda19 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:49.651578 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c132a2d0-de86-4e03-b7a0-328980abda19 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:49.660449 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-c132a2d0-de86-4e03-b7a0-328980abda19 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1573 microversion: 2.1 time: 0.152954 Jun 15 14:50:49.661025 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 490/953] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:49 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:50.123339 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-64e12e7f-718f-446f-b0f3-f486fa0e2ab5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:50.123958 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-64e12e7f-718f-446f-b0f3-f486fa0e2ab5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:50.130111 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-64e12e7f-718f-446f-b0f3-f486fa0e2ab5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:50.130573 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-64e12e7f-718f-446f-b0f3-f486fa0e2ab5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:50.131338 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-64e12e7f-718f-446f-b0f3-f486fa0e2ab5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:50.131779 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-64e12e7f-718f-446f-b0f3-f486fa0e2ab5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:50.258409 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-64e12e7f-718f-446f-b0f3-f486fa0e2ab5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:50.265743 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-64e12e7f-718f-446f-b0f3-f486fa0e2ab5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1368 microversion: 2.1 time: 0.146302 Jun 15 14:50:50.266309 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 464/954] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:50 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:50.408724 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-d6cd0087-5d92-415e-b16f-7f29c6925195 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:50.409309 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-d6cd0087-5d92-415e-b16f-7f29c6925195 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:50.415880 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d6cd0087-5d92-415e-b16f-7f29c6925195 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:50.416330 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d6cd0087-5d92-415e-b16f-7f29c6925195 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:50.417093 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d6cd0087-5d92-415e-b16f-7f29c6925195 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:50.417532 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d6cd0087-5d92-415e-b16f-7f29c6925195 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:50.553989 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d6cd0087-5d92-415e-b16f-7f29c6925195 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:50.561988 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d6cd0087-5d92-415e-b16f-7f29c6925195 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:50.563491 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d6cd0087-5d92-415e-b16f-7f29c6925195 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:50.564684 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-d6cd0087-5d92-415e-b16f-7f29c6925195 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1727 microversion: 2.20 time: 0.160677 Jun 15 14:50:50.565244 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 491/955] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:50 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:50.676285 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-4be539e8-5b44-477f-bf2f-5fafbc3eea23 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:50.676835 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-4be539e8-5b44-477f-bf2f-5fafbc3eea23 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:50.682841 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4be539e8-5b44-477f-bf2f-5fafbc3eea23 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:50.683300 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4be539e8-5b44-477f-bf2f-5fafbc3eea23 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:50.684064 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4be539e8-5b44-477f-bf2f-5fafbc3eea23 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:50.684502 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4be539e8-5b44-477f-bf2f-5fafbc3eea23 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:50.818017 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-4be539e8-5b44-477f-bf2f-5fafbc3eea23 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:50.825582 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-4be539e8-5b44-477f-bf2f-5fafbc3eea23 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1560 microversion: 2.1 time: 0.153253 Jun 15 14:50:50.826289 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 465/956] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:50 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:51.284889 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-23cfc5e8-613b-4e58-abc2-9b524a37ad19 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:51.285504 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-23cfc5e8-613b-4e58-abc2-9b524a37ad19 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:51.291534 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-23cfc5e8-613b-4e58-abc2-9b524a37ad19 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:51.291980 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-23cfc5e8-613b-4e58-abc2-9b524a37ad19 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:51.292731 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-23cfc5e8-613b-4e58-abc2-9b524a37ad19 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:51.293168 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-23cfc5e8-613b-4e58-abc2-9b524a37ad19 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:51.425219 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-23cfc5e8-613b-4e58-abc2-9b524a37ad19 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:51.432748 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-23cfc5e8-613b-4e58-abc2-9b524a37ad19 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1368 microversion: 2.1 time: 0.153493 Jun 15 14:50:51.433309 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 492/957] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:51 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:51.583559 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-53fa108f-34e2-4963-b9c8-c3763913de33 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:51.584167 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-53fa108f-34e2-4963-b9c8-c3763913de33 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:51.590567 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-53fa108f-34e2-4963-b9c8-c3763913de33 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:51.591018 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-53fa108f-34e2-4963-b9c8-c3763913de33 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:51.591780 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-53fa108f-34e2-4963-b9c8-c3763913de33 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:51.592219 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-53fa108f-34e2-4963-b9c8-c3763913de33 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:51.720271 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-53fa108f-34e2-4963-b9c8-c3763913de33 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:51.728435 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-53fa108f-34e2-4963-b9c8-c3763913de33 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:51.729946 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-53fa108f-34e2-4963-b9c8-c3763913de33 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:51.731097 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-53fa108f-34e2-4963-b9c8-c3763913de33 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1727 microversion: 2.20 time: 0.152200 Jun 15 14:50:51.731654 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 466/958] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:51 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:50:52.453615 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-bf616e37-2e88-4995-919e-d4cf03ebee40 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:52.455919 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-bf616e37-2e88-4995-919e-d4cf03ebee40 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:52.462969 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bf616e37-2e88-4995-919e-d4cf03ebee40 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:52.463427 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bf616e37-2e88-4995-919e-d4cf03ebee40 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:52.464204 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bf616e37-2e88-4995-919e-d4cf03ebee40 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:52.465037 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bf616e37-2e88-4995-919e-d4cf03ebee40 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:52.603616 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-bf616e37-2e88-4995-919e-d4cf03ebee40 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:52.611205 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-bf616e37-2e88-4995-919e-d4cf03ebee40 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1368 microversion: 2.1 time: 0.161473 Jun 15 14:50:52.611940 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 493/959] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:52 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:52.678982 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c0283bc5-229b-4d07-a5e7-3b55a15b5ae6 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:52.679917 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-c0283bc5-229b-4d07-a5e7-3b55a15b5ae6 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:52.686398 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c0283bc5-229b-4d07-a5e7-3b55a15b5ae6 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:52.686849 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c0283bc5-229b-4d07-a5e7-3b55a15b5ae6 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:52.687613 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c0283bc5-229b-4d07-a5e7-3b55a15b5ae6 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:52.688047 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c0283bc5-229b-4d07-a5e7-3b55a15b5ae6 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:52.712701 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=100 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:52.718174 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-c0283bc5-229b-4d07-a5e7-3b55a15b5ae6 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043159 Jun 15 14:50:52.718736 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 467/960] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 14:50:52 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:52.729501 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-dd608cf7-c345-4808-b3cc-de90895a8b4d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:52.730135 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-dd608cf7-c345-4808-b3cc-de90895a8b4d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:52.736241 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-dd608cf7-c345-4808-b3cc-de90895a8b4d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:52.736838 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-dd608cf7-c345-4808-b3cc-de90895a8b4d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:52.737601 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-dd608cf7-c345-4808-b3cc-de90895a8b4d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:52.738081 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-dd608cf7-c345-4808-b3cc-de90895a8b4d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:52.748084 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-8157a368-dd70-4106-8af4-d97ec2a262e9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:52.748697 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-8157a368-dd70-4106-8af4-d97ec2a262e9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:52.754912 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8157a368-dd70-4106-8af4-d97ec2a262e9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:52.755366 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8157a368-dd70-4106-8af4-d97ec2a262e9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:52.756144 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8157a368-dd70-4106-8af4-d97ec2a262e9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:52.756580 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8157a368-dd70-4106-8af4-d97ec2a262e9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:52.767004 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-dd608cf7-c345-4808-b3cc-de90895a8b4d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb/os-volume_attachments/2be37b48-ee79-45c2-b816-1d0388f6599f" status: 200 len: 194 microversion: 2.1 time: 0.041548 Jun 15 14:50:52.768612 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 494/961] 10.222.0.57 () {58 vars in 1412 bytes} [Wed Jun 15 14:50:52 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb/os-volume_attachments/2be37b48-ee79-45c2-b816-1d0388f6599f => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:52.891851 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-8157a368-dd70-4106-8af4-d97ec2a262e9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:52.901682 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-8157a368-dd70-4106-8af4-d97ec2a262e9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:52.903175 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-8157a368-dd70-4106-8af4-d97ec2a262e9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:52.904370 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-8157a368-dd70-4106-8af4-d97ec2a262e9 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1727 microversion: 2.20 time: 0.160092 Jun 15 14:50:52.904876 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 468/962] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:52 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:50:53.630082 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-a86dd410-c597-4858-bba8-33d6b987f669 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:53.630701 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-a86dd410-c597-4858-bba8-33d6b987f669 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:53.637232 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a86dd410-c597-4858-bba8-33d6b987f669 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:53.637721 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a86dd410-c597-4858-bba8-33d6b987f669 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:53.638485 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a86dd410-c597-4858-bba8-33d6b987f669 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:53.638932 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a86dd410-c597-4858-bba8-33d6b987f669 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:53.783852 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-a86dd410-c597-4858-bba8-33d6b987f669 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:53.791217 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-a86dd410-c597-4858-bba8-33d6b987f669 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1368 microversion: 2.1 time: 0.167046 Jun 15 14:50:53.791788 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 495/963] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:53 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:53.924488 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-124c547c-95fe-4d85-b6c5-979d0c47c832 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:53.925788 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-124c547c-95fe-4d85-b6c5-979d0c47c832 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:53.933338 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-124c547c-95fe-4d85-b6c5-979d0c47c832 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:53.934083 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-124c547c-95fe-4d85-b6c5-979d0c47c832 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:53.935262 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-124c547c-95fe-4d85-b6c5-979d0c47c832 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:53.935927 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-124c547c-95fe-4d85-b6c5-979d0c47c832 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:54.072555 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-124c547c-95fe-4d85-b6c5-979d0c47c832 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:54.081185 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-124c547c-95fe-4d85-b6c5-979d0c47c832 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:54.082752 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-124c547c-95fe-4d85-b6c5-979d0c47c832 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:54.083918 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-124c547c-95fe-4d85-b6c5-979d0c47c832 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1727 microversion: 2.20 time: 0.164783 Jun 15 14:50:54.084710 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 469/964] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:53 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:50:54.090529 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-63f904ba-cd37-46a7-9e7f-b8e5e4dd5b64 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e8309a7-155b-4423-8813-f22e5e7b8faa"}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:54.091661 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-63f904ba-cd37-46a7-9e7f-b8e5e4dd5b64 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:54.098524 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-63f904ba-cd37-46a7-9e7f-b8e5e4dd5b64 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:54.098972 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-63f904ba-cd37-46a7-9e7f-b8e5e4dd5b64 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:54.099732 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-63f904ba-cd37-46a7-9e7f-b8e5e4dd5b64 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:54.100168 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-63f904ba-cd37-46a7-9e7f-b8e5e4dd5b64 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:54.724136 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-63f904ba-cd37-46a7-9e7f-b8e5e4dd5b64 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "POST /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.637204 Jun 15 14:50:54.724789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 496/965] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 14:50:54 2022] POST /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb/os-volume_attachments => generated 194 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:54.808336 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a3806f83-59a1-4ca0-bba0-1e71b11c5670 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:54.808947 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a3806f83-59a1-4ca0-bba0-1e71b11c5670 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:54.815823 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a3806f83-59a1-4ca0-bba0-1e71b11c5670 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:54.816276 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a3806f83-59a1-4ca0-bba0-1e71b11c5670 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:54.817039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a3806f83-59a1-4ca0-bba0-1e71b11c5670 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:54.817480 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a3806f83-59a1-4ca0-bba0-1e71b11c5670 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:54.968748 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a3806f83-59a1-4ca0-bba0-1e71b11c5670 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:54.985480 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a3806f83-59a1-4ca0-bba0-1e71b11c5670 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1559 microversion: 2.1 time: 0.179950 Jun 15 14:50:54.988011 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 470/966] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:54 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:55.004958 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-726db999-31a4-4d8b-ae80-0a908841b945 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:55.007512 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-726db999-31a4-4d8b-ae80-0a908841b945 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:55.015699 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-726db999-31a4-4d8b-ae80-0a908841b945 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:55.016540 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-726db999-31a4-4d8b-ae80-0a908841b945 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:55.018153 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-726db999-31a4-4d8b-ae80-0a908841b945 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:55.018793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-726db999-31a4-4d8b-ae80-0a908841b945 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:55.100998 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-726db999-31a4-4d8b-ae80-0a908841b945 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100467 Jun 15 14:50:55.101592 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 497/967] 10.222.0.57 () {58 vars in 1274 bytes} [Wed Jun 15 14:50:54 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:55.102253 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-7745ed5f-fe57-43d4-b9c2-c53a733b9be0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:55.102914 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-7745ed5f-fe57-43d4-b9c2-c53a733b9be0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:55.110034 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7745ed5f-fe57-43d4-b9c2-c53a733b9be0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:55.110480 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7745ed5f-fe57-43d4-b9c2-c53a733b9be0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:55.112423 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7745ed5f-fe57-43d4-b9c2-c53a733b9be0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:55.112868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7745ed5f-fe57-43d4-b9c2-c53a733b9be0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:55.184084 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-779240eb-2c17-41d3-96c4-7511c35f72a7 req-42c606e6-a252-4daa-bfc3-ce96b61787bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d0cbdc8-d87b-4ce4-97d1-59aca342287a", "name": "network-vif-plugged", "status": "completed", "tag": "bf1963f9-4d7c-4562-9c53-6c53a728e8c6"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:55.194306 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-779240eb-2c17-41d3-96c4-7511c35f72a7 req-42c606e6-a252-4daa-bfc3-ce96b61787bc service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:55.194995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-779240eb-2c17-41d3-96c4-7511c35f72a7 req-42c606e6-a252-4daa-bfc3-ce96b61787bc service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:55.208939 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-779240eb-2c17-41d3-96c4-7511c35f72a7 req-42c606e6-a252-4daa-bfc3-ce96b61787bc service nova] Creating event network-vif-plugged:bf1963f9-4d7c-4562-9c53-6c53a728e8c6 for instance 7d0cbdc8-d87b-4ce4-97d1-59aca342287a on hv-cinder-84327 Jun 15 14:50:55.214072 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-779240eb-2c17-41d3-96c4-7511c35f72a7 req-42c606e6-a252-4daa-bfc3-ce96b61787bc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036637 Jun 15 14:50:55.215241 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 498/968] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:50:55.267750 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-7745ed5f-fe57-43d4-b9c2-c53a733b9be0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:55.276826 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-7745ed5f-fe57-43d4-b9c2-c53a733b9be0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:55.278374 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-7745ed5f-fe57-43d4-b9c2-c53a733b9be0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:55.279653 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-7745ed5f-fe57-43d4-b9c2-c53a733b9be0 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1727 microversion: 2.20 time: 0.181609 Jun 15 14:50:55.280217 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 471/969] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:55 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1727 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:50:56.300402 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-5abc660b-b68f-466c-8014-9b7b3a46dbf7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:56.301143 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-5abc660b-b68f-466c-8014-9b7b3a46dbf7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:56.307784 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5abc660b-b68f-466c-8014-9b7b3a46dbf7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:56.308239 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5abc660b-b68f-466c-8014-9b7b3a46dbf7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:56.309006 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5abc660b-b68f-466c-8014-9b7b3a46dbf7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:56.309462 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5abc660b-b68f-466c-8014-9b7b3a46dbf7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:56.395078 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-e1fe43a0-ca56-4e0e-b798-89b500b0e976 req-2b7ca0f1-2210-45bc-833c-b046db1f1bab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a97884f7-868c-4b2a-b518-feac560b9eff", "tag": "147f701a-dd9f-4cee-8def-a74eb3f0c1fd"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:56.405187 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-e1fe43a0-ca56-4e0e-b798-89b500b0e976 req-2b7ca0f1-2210-45bc-833c-b046db1f1bab service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:56.405814 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-e1fe43a0-ca56-4e0e-b798-89b500b0e976 req-2b7ca0f1-2210-45bc-833c-b046db1f1bab service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:56.418083 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-e1fe43a0-ca56-4e0e-b798-89b500b0e976 req-2b7ca0f1-2210-45bc-833c-b046db1f1bab service nova] Creating event network-changed:147f701a-dd9f-4cee-8def-a74eb3f0c1fd for instance a97884f7-868c-4b2a-b518-feac560b9eff on hv-cinder-84327 Jun 15 14:50:56.424308 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-e1fe43a0-ca56-4e0e-b798-89b500b0e976 req-2b7ca0f1-2210-45bc-833c-b046db1f1bab service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032189 Jun 15 14:50:56.425183 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 472/970] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:56.466791 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-5abc660b-b68f-466c-8014-9b7b3a46dbf7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:56.476026 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-5abc660b-b68f-466c-8014-9b7b3a46dbf7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:56.477574 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-5abc660b-b68f-466c-8014-9b7b3a46dbf7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:56.479156 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-5abc660b-b68f-466c-8014-9b7b3a46dbf7 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1727 microversion: 2.20 time: 0.183800 Jun 15 14:50:56.479712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 499/971] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:56 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1727 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:57.498965 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-ffd92791-8f95-47ae-b01d-0f2b2c97701c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:57.499663 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-ffd92791-8f95-47ae-b01d-0f2b2c97701c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:57.506639 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ffd92791-8f95-47ae-b01d-0f2b2c97701c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:57.507125 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ffd92791-8f95-47ae-b01d-0f2b2c97701c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:57.507907 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ffd92791-8f95-47ae-b01d-0f2b2c97701c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:57.508302 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ffd92791-8f95-47ae-b01d-0f2b2c97701c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:57.657112 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ffd92791-8f95-47ae-b01d-0f2b2c97701c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:57.666745 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ffd92791-8f95-47ae-b01d-0f2b2c97701c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:57.668759 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ffd92791-8f95-47ae-b01d-0f2b2c97701c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:57.671028 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-ffd92791-8f95-47ae-b01d-0f2b2c97701c tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1727 microversion: 2.20 time: 0.176743 Jun 15 14:50:57.671607 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 473/972] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:57 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:58.690835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-692b570f-1fc4-4f30-8eda-2d785ff164c1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:58.691492 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-692b570f-1fc4-4f30-8eda-2d785ff164c1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:58.697702 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-692b570f-1fc4-4f30-8eda-2d785ff164c1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:58.698206 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-692b570f-1fc4-4f30-8eda-2d785ff164c1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:58.699004 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-692b570f-1fc4-4f30-8eda-2d785ff164c1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:58.699467 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-692b570f-1fc4-4f30-8eda-2d785ff164c1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:58.836830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-692b570f-1fc4-4f30-8eda-2d785ff164c1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:58.844721 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-692b570f-1fc4-4f30-8eda-2d785ff164c1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:58.847340 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-692b570f-1fc4-4f30-8eda-2d785ff164c1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:58.848484 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-692b570f-1fc4-4f30-8eda-2d785ff164c1 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1714 microversion: 2.20 time: 0.162591 Jun 15 14:50:58.849035 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 500/973] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:50:58 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1714 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:00.109126 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-75f7ff14-7bdd-4353-bd37-4decf7eff64c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:00.110103 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-75f7ff14-7bdd-4353-bd37-4decf7eff64c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:00.117343 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-75f7ff14-7bdd-4353-bd37-4decf7eff64c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:00.117839 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-75f7ff14-7bdd-4353-bd37-4decf7eff64c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:00.118614 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-75f7ff14-7bdd-4353-bd37-4decf7eff64c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:00.119058 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-75f7ff14-7bdd-4353-bd37-4decf7eff64c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:00.149221 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-75f7ff14-7bdd-4353-bd37-4decf7eff64c tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044105 Jun 15 14:51:00.149868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 474/974] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 14:51:00 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:51:00.322490 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c7a81374-a97b-4324-84f2-203779adab99 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:00.323081 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c7a81374-a97b-4324-84f2-203779adab99 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:00.330837 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c7a81374-a97b-4324-84f2-203779adab99 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:00.331292 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c7a81374-a97b-4324-84f2-203779adab99 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:00.332067 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c7a81374-a97b-4324-84f2-203779adab99 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:00.332511 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c7a81374-a97b-4324-84f2-203779adab99 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:00.349211 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:00.364734 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-c7a81374-a97b-4324-84f2-203779adab99 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb/os-volume_attachments/2be37b48-ee79-45c2-b816-1d0388f6599f" status: 200 len: 194 microversion: 2.1 time: 0.046230 Jun 15 14:51:00.365310 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 501/975] 10.222.0.57 () {58 vars in 1412 bytes} [Wed Jun 15 14:51:00 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb/os-volume_attachments/2be37b48-ee79-45c2-b816-1d0388f6599f => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:51:00.375199 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-821856a7-f463-4f43-92b4-592b45986dd8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:00.375700 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-821856a7-f463-4f43-92b4-592b45986dd8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:00.382404 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-821856a7-f463-4f43-92b4-592b45986dd8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:00.382908 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-821856a7-f463-4f43-92b4-592b45986dd8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:00.383681 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-821856a7-f463-4f43-92b4-592b45986dd8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:00.384124 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-821856a7-f463-4f43-92b4-592b45986dd8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:00.464022 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.objects.instance [None req-821856a7-f463-4f43-92b4-592b45986dd8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lazy-loading 'services' on Instance uuid 614be0bb-764c-4e45-ab82-656b13ded3bb {{(pid=124220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:51:00.535117 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-821856a7-f463-4f43-92b4-592b45986dd8 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "DELETE /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb/os-volume_attachments/2be37b48-ee79-45c2-b816-1d0388f6599f" status: 202 len: 0 microversion: 2.1 time: 0.163799 Jun 15 14:51:00.535717 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 475/976] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Jun 15 14:51:00 2022] DELETE /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb/os-volume_attachments/2be37b48-ee79-45c2-b816-1d0388f6599f => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:51:03.755792 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-56315a75-179a-47dd-8f4d-f4f6b4499e8e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:03.756296 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-56315a75-179a-47dd-8f4d-f4f6b4499e8e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:03.763054 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-56315a75-179a-47dd-8f4d-f4f6b4499e8e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:03.763508 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-56315a75-179a-47dd-8f4d-f4f6b4499e8e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:03.764276 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-56315a75-179a-47dd-8f4d-f4f6b4499e8e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:03.764718 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-56315a75-179a-47dd-8f4d-f4f6b4499e8e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:03.794216 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-56315a75-179a-47dd-8f4d-f4f6b4499e8e tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb/os-volume_attachments/0e8309a7-155b-4423-8813-f22e5e7b8faa" status: 200 len: 194 microversion: 2.1 time: 0.042651 Jun 15 14:51:03.794788 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 502/977] 10.222.0.57 () {58 vars in 1412 bytes} [Wed Jun 15 14:51:03 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb/os-volume_attachments/0e8309a7-155b-4423-8813-f22e5e7b8faa => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:51:03.805946 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a5c9cb0a-2425-45dd-bfa8-5c6e3de12ca9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:03.806524 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a5c9cb0a-2425-45dd-bfa8-5c6e3de12ca9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:03.812713 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a5c9cb0a-2425-45dd-bfa8-5c6e3de12ca9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:03.813158 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a5c9cb0a-2425-45dd-bfa8-5c6e3de12ca9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:03.813955 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a5c9cb0a-2425-45dd-bfa8-5c6e3de12ca9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:03.814898 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a5c9cb0a-2425-45dd-bfa8-5c6e3de12ca9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:03.895102 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.objects.instance [None req-a5c9cb0a-2425-45dd-bfa8-5c6e3de12ca9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lazy-loading 'services' on Instance uuid 614be0bb-764c-4e45-ab82-656b13ded3bb {{(pid=124220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:51:03.964590 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a5c9cb0a-2425-45dd-bfa8-5c6e3de12ca9 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "DELETE /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb/os-volume_attachments/0e8309a7-155b-4423-8813-f22e5e7b8faa" status: 202 len: 0 microversion: 2.1 time: 0.163272 Jun 15 14:51:03.965166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 476/978] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Jun 15 14:51:03 2022] DELETE /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb/os-volume_attachments/0e8309a7-155b-4423-8813-f22e5e7b8faa => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:51:06.172364 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-9887bb9d-41dd-4344-8e74-dcce0970490a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:06.173355 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-9887bb9d-41dd-4344-8e74-dcce0970490a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:06.176275 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=65 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:06.181973 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9887bb9d-41dd-4344-8e74-dcce0970490a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:06.182428 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9887bb9d-41dd-4344-8e74-dcce0970490a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:06.183200 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9887bb9d-41dd-4344-8e74-dcce0970490a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:06.183646 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9887bb9d-41dd-4344-8e74-dcce0970490a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:06.212237 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-9887bb9d-41dd-4344-8e74-dcce0970490a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043824 Jun 15 14:51:06.212793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 503/979] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 14:51:06 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 14:51:06.317433 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-3aced06c-a071-4baa-a862-8f2dc44ed1c6 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:06.318555 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-3aced06c-a071-4baa-a862-8f2dc44ed1c6 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:06.325429 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3aced06c-a071-4baa-a862-8f2dc44ed1c6 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:06.326067 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3aced06c-a071-4baa-a862-8f2dc44ed1c6 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:06.326897 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3aced06c-a071-4baa-a862-8f2dc44ed1c6 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:06.327289 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3aced06c-a071-4baa-a862-8f2dc44ed1c6 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:06.355778 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-3aced06c-a071-4baa-a862-8f2dc44ed1c6 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043994 Jun 15 14:51:06.356335 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 477/980] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 14:51:06 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 14:51:06.412253 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3fb14ddc-1d72-476f-9a7d-8983ea78e187 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:06.412757 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-3fb14ddc-1d72-476f-9a7d-8983ea78e187 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:06.418924 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3fb14ddc-1d72-476f-9a7d-8983ea78e187 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:06.419380 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3fb14ddc-1d72-476f-9a7d-8983ea78e187 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:06.420146 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3fb14ddc-1d72-476f-9a7d-8983ea78e187 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:06.420617 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3fb14ddc-1d72-476f-9a7d-8983ea78e187 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:06.445971 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-3fb14ddc-1d72-476f-9a7d-8983ea78e187 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Going to try to terminate instance {{(pid=124219) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:51:06.522714 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-3fb14ddc-1d72-476f-9a7d-8983ea78e187 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "DELETE /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb" status: 204 len: 0 microversion: 2.1 time: 0.114498 Jun 15 14:51:06.523287 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 504/981] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:51:06 2022] DELETE /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:51:06.531804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a06d4271-a628-4e89-b8fd-9200625340c6 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:06.532535 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a06d4271-a628-4e89-b8fd-9200625340c6 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:06.539147 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a06d4271-a628-4e89-b8fd-9200625340c6 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:06.539607 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a06d4271-a628-4e89-b8fd-9200625340c6 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:06.540636 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a06d4271-a628-4e89-b8fd-9200625340c6 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:06.541148 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a06d4271-a628-4e89-b8fd-9200625340c6 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:06.669553 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a06d4271-a628-4e89-b8fd-9200625340c6 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:06.677231 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a06d4271-a628-4e89-b8fd-9200625340c6 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb" status: 200 len: 1674 microversion: 2.1 time: 0.149463 Jun 15 14:51:06.677826 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 478/982] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:06 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:07.694806 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-97e56a3d-57c2-4553-b8fc-e0a17b37dd59 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:07.695504 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-97e56a3d-57c2-4553-b8fc-e0a17b37dd59 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:07.701985 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-97e56a3d-57c2-4553-b8fc-e0a17b37dd59 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:07.702437 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-97e56a3d-57c2-4553-b8fc-e0a17b37dd59 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:07.703197 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-97e56a3d-57c2-4553-b8fc-e0a17b37dd59 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:07.703636 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-97e56a3d-57c2-4553-b8fc-e0a17b37dd59 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:07.839582 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-97e56a3d-57c2-4553-b8fc-e0a17b37dd59 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:07.848151 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-97e56a3d-57c2-4553-b8fc-e0a17b37dd59 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb" status: 200 len: 1674 microversion: 2.1 time: 0.157630 Jun 15 14:51:07.848718 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 505/983] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:07 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:08.866220 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-dee05570-628b-48ac-9515-0bf2cc466591 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:08.866826 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-dee05570-628b-48ac-9515-0bf2cc466591 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:08.873347 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-dee05570-628b-48ac-9515-0bf2cc466591 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:08.873840 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-dee05570-628b-48ac-9515-0bf2cc466591 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:08.874603 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-dee05570-628b-48ac-9515-0bf2cc466591 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:08.875041 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-dee05570-628b-48ac-9515-0bf2cc466591 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:09.002806 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-dee05570-628b-48ac-9515-0bf2cc466591 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:09.010330 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-dee05570-628b-48ac-9515-0bf2cc466591 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb" status: 200 len: 1674 microversion: 2.1 time: 0.148076 Jun 15 14:51:09.010878 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 479/984] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:08 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:10.028274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-383f2dc7-5b09-4cb7-8b7e-7a028dba2660 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:10.028888 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-383f2dc7-5b09-4cb7-8b7e-7a028dba2660 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:10.036105 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-383f2dc7-5b09-4cb7-8b7e-7a028dba2660 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:10.036556 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-383f2dc7-5b09-4cb7-8b7e-7a028dba2660 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:10.037314 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-383f2dc7-5b09-4cb7-8b7e-7a028dba2660 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:10.037772 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-383f2dc7-5b09-4cb7-8b7e-7a028dba2660 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:10.101505 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-383f2dc7-5b09-4cb7-8b7e-7a028dba2660 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:10.109403 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-383f2dc7-5b09-4cb7-8b7e-7a028dba2660 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb" status: 200 len: 1607 microversion: 2.1 time: 0.084999 Jun 15 14:51:10.110021 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 506/985] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:10 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb => generated 1607 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:10.434873 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-09d2de62-3ebb-4d2e-a1cc-3a7b7b218831 req-654726b5-2aa2-48cc-ae63-8474c503bba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614be0bb-764c-4e45-ab82-656b13ded3bb", "name": "network-vif-deleted", "tag": "c504934d-47ed-419a-8f48-11ec467c239b"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:10.444314 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-09d2de62-3ebb-4d2e-a1cc-3a7b7b218831 req-654726b5-2aa2-48cc-ae63-8474c503bba0 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:10.445283 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-09d2de62-3ebb-4d2e-a1cc-3a7b7b218831 req-654726b5-2aa2-48cc-ae63-8474c503bba0 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:10.459465 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-09d2de62-3ebb-4d2e-a1cc-3a7b7b218831 req-654726b5-2aa2-48cc-ae63-8474c503bba0 service nova] Creating event network-vif-deleted:c504934d-47ed-419a-8f48-11ec467c239b for instance 614be0bb-764c-4e45-ab82-656b13ded3bb on hv-cinder-84327 Jun 15 14:51:10.464874 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-09d2de62-3ebb-4d2e-a1cc-3a7b7b218831 req-654726b5-2aa2-48cc-ae63-8474c503bba0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033719 Jun 15 14:51:10.466013 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 480/986] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:51:11.127696 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-872fca01-b522-453b-8793-e86fc2add225 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:11.128509 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-872fca01-b522-453b-8793-e86fc2add225 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:11.135835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-872fca01-b522-453b-8793-e86fc2add225 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:11.136290 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-872fca01-b522-453b-8793-e86fc2add225 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:11.137079 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-872fca01-b522-453b-8793-e86fc2add225 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:11.137524 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-872fca01-b522-453b-8793-e86fc2add225 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:11.182258 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-872fca01-b522-453b-8793-e86fc2add225 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:11.182948 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-872fca01-b522-453b-8793-e86fc2add225 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:11.183704 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.objects.instance [None req-872fca01-b522-453b-8793-e86fc2add225 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lazy-loading 'fault' on Instance uuid 614be0bb-764c-4e45-ab82-656b13ded3bb {{(pid=124219) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:51:11.235263 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-872fca01-b522-453b-8793-e86fc2add225 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ff37865a9b49ec8601140fca00a627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c12c8e1398843eca8746543a0684841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:11.243393 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-872fca01-b522-453b-8793-e86fc2add225 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb" status: 200 len: 1328 microversion: 2.1 time: 0.120171 Jun 15 14:51:11.244160 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 507/987] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:11 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb => generated 1328 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:12.261868 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-dc747e54-2041-47bf-a186-29f6ea49c62d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:12.262604 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-dc747e54-2041-47bf-a186-29f6ea49c62d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:12.264523 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=54 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:12.270725 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-dc747e54-2041-47bf-a186-29f6ea49c62d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:12.271177 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-dc747e54-2041-47bf-a186-29f6ea49c62d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:12.271940 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-dc747e54-2041-47bf-a186-29f6ea49c62d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:12.272378 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-dc747e54-2041-47bf-a186-29f6ea49c62d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:12.286147 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.wsgi [None req-dc747e54-2041-47bf-a186-29f6ea49c62d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] HTTP exception thrown: Instance 614be0bb-764c-4e45-ab82-656b13ded3bb could not be found. Jun 15 14:51:12.287749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-dc747e54-2041-47bf-a186-29f6ea49c62d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Request method failure captured: Jun 15 14:51:12.287749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: request: GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb HTTP/1.1 Jun 15 14:51:12.287749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept: application/json Jun 15 14:51:12.287749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept-Encoding: identity Jun 15 14:51:12.287749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Connection: close Jun 15 14:51:12.287749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Length: 0 Jun 15 14:51:12.287749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Type: application/json Jun 15 14:51:12.287749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Host: 10.222.0.57 Jun 15 14:51:12.287749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Openstack-System-Scope: None Jun 15 14:51:12.287749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: User-Agent: python-urllib3/1.26.9 Jun 15 14:51:12.287749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Auth-Token: gAAAAABiqfAJbOMAn4uuMkObo-mKlEXE2sBkt8BVXSXuSs2-tUHPjy235pz3ZfhHF4IXCVW6sAR2sfQIWe12-EdW2FzfFNe8sHSOX5z1Z169ZX9Np5yjTEqN-R545Wm35ZLsEh7ox97tPIOOrfTYdJHHGByAhvQkLnH24ukI9ee6odfAZSUkUuw Jun 15 14:51:12.287749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Id: None Jun 15 14:51:12.287749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Name: None Jun 15 14:51:12.287749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Identity-Status: Confirmed Jun 15 14:51:12.287749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Is-Admin-Project: True Jun 15 14:51:12.287749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Id: default Jun 15 14:51:12.287749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Name: Default Jun 15 14:51:12.287749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Id: 0c12c8e1398843eca8746543a0684841 Jun 15 14:51:12.287749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Name: tempest-AttachVolumeTestJSON-2133096874 Jun 15 14:51:12.287749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Role: member,reader Jun 15 14:51:12.287749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Roles: member,reader Jun 15 14:51:12.289428 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0c12c8e1398843eca8746543a0684841"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0c12c8e1398843eca8746543a0684841", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0c12c8e1398843eca8746543a0684841"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0c12c8e1398843eca8746543a0684841"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:51:12.289428 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant: tempest-AttachVolumeTestJSON-2133096874 Jun 15 14:51:12.289428 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Id: 0c12c8e1398843eca8746543a0684841 Jun 15 14:51:12.289428 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2133096874 Jun 15 14:51:12.289428 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User: tempest-AttachVolumeTestJSON-2133096874-project Jun 15 14:51:12.289428 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Id: default Jun 15 14:51:12.289428 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Name: Default Jun 15 14:51:12.289428 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Id: 28ff37865a9b49ec8601140fca00a627 Jun 15 14:51:12.289428 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Name: tempest-AttachVolumeTestJSON-2133096874-project Jun 15 14:51:12.289428 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: method: > Jun 15 14:51:12.289428 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: exception: Instance 614be0bb-764c-4e45-ab82-656b13ded3bb could not be found. Jun 15 14:51:12.289428 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: action_args: {'id': '614be0bb-764c-4e45-ab82-656b13ded3bb'} Jun 15 14:51:12.290465 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:51:12.290465 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:12.290465 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:51:12.290465 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:51:12.290465 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:51:12.290465 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:51:12.290465 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:51:12.290465 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:51:12.290465 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:51:12.290465 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:51:12.290465 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 614be0bb-764c-4e45-ab82-656b13ded3bb could not be found. Jun 15 14:51:12.290465 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:12.290465 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:12.290465 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:12.290465 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:12.290465 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:12.290465 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:12.290465 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:51:12.290465 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:51:12.290465 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:51:12.291960 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:51:12.291960 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:51:12.291960 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:51:12.291960 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:51:12.291960 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:51:12.291960 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:51:12.291960 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:51:12.291960 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 614be0bb-764c-4e45-ab82-656b13ded3bb could not be found. Jun 15 14:51:12.291960 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:12.291960 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:12.291960 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:12.291960 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:12.291960 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:12.291960 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:12.291960 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:51:12.291960 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:51:12.291960 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 614be0bb-764c-4e45-ab82-656b13ded3bb could not be found. Jun 15 14:51:12.291960 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:12.293432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-dc747e54-2041-47bf-a186-29f6ea49c62d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Returning 404 to user: Instance 614be0bb-764c-4e45-ab82-656b13ded3bb could not be found. {{(pid=124220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:51:12.293432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-dc747e54-2041-47bf-a186-29f6ea49c62d tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb" status: 404 len: 111 microversion: 2.1 time: 0.032128 Jun 15 14:51:12.293432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 481/988] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:12 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:51:12.298181 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-15f43c8b-57fe-4a48-a9e8-ef60f1e282ee tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '.version_select at 0x7f8f200b69d0>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:12.315968 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-15f43c8b-57fe-4a48-a9e8-ef60f1e282ee tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1426052754" status: 202 len: 0 microversion: 2.1 time: 0.021494 Jun 15 14:51:12.316522 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 508/989] 10.222.0.57 () {58 vars in 1220 bytes} [Wed Jun 15 14:51:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1426052754 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:51:15.186069 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-7f2ad942-4530-443f-8695-84dcbc54491a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:15.186579 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-7f2ad942-4530-443f-8695-84dcbc54491a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:15.193253 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7f2ad942-4530-443f-8695-84dcbc54491a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:15.193739 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7f2ad942-4530-443f-8695-84dcbc54491a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:15.194508 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7f2ad942-4530-443f-8695-84dcbc54491a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:15.194946 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7f2ad942-4530-443f-8695-84dcbc54491a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:15.208631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.wsgi [None req-7f2ad942-4530-443f-8695-84dcbc54491a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] HTTP exception thrown: Instance 614be0bb-764c-4e45-ab82-656b13ded3bb could not be found. Jun 15 14:51:15.210175 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-7f2ad942-4530-443f-8695-84dcbc54491a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Request method failure captured: Jun 15 14:51:15.210175 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: request: DELETE /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb HTTP/1.1 Jun 15 14:51:15.210175 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept: application/json Jun 15 14:51:15.210175 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept-Encoding: identity Jun 15 14:51:15.210175 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Connection: close Jun 15 14:51:15.210175 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Length: 0 Jun 15 14:51:15.210175 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Type: application/json Jun 15 14:51:15.210175 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Host: 10.222.0.57 Jun 15 14:51:15.210175 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Openstack-System-Scope: None Jun 15 14:51:15.210175 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: User-Agent: python-urllib3/1.26.9 Jun 15 14:51:15.210175 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Auth-Token: gAAAAABiqfAJbOMAn4uuMkObo-mKlEXE2sBkt8BVXSXuSs2-tUHPjy235pz3ZfhHF4IXCVW6sAR2sfQIWe12-EdW2FzfFNe8sHSOX5z1Z169ZX9Np5yjTEqN-R545Wm35ZLsEh7ox97tPIOOrfTYdJHHGByAhvQkLnH24ukI9ee6odfAZSUkUuw Jun 15 14:51:15.210175 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Id: None Jun 15 14:51:15.210175 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Name: None Jun 15 14:51:15.210175 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Identity-Status: Confirmed Jun 15 14:51:15.210175 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Is-Admin-Project: True Jun 15 14:51:15.210175 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Id: default Jun 15 14:51:15.210175 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Name: Default Jun 15 14:51:15.210175 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Id: 0c12c8e1398843eca8746543a0684841 Jun 15 14:51:15.210175 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Name: tempest-AttachVolumeTestJSON-2133096874 Jun 15 14:51:15.210175 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Role: member,reader Jun 15 14:51:15.210175 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Roles: member,reader Jun 15 14:51:15.211727 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0c12c8e1398843eca8746543a0684841"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0c12c8e1398843eca8746543a0684841", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0c12c8e1398843eca8746543a0684841"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0c12c8e1398843eca8746543a0684841"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:51:15.211727 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant: tempest-AttachVolumeTestJSON-2133096874 Jun 15 14:51:15.211727 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Id: 0c12c8e1398843eca8746543a0684841 Jun 15 14:51:15.211727 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2133096874 Jun 15 14:51:15.211727 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User: tempest-AttachVolumeTestJSON-2133096874-project Jun 15 14:51:15.211727 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Id: default Jun 15 14:51:15.211727 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Name: Default Jun 15 14:51:15.211727 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Id: 28ff37865a9b49ec8601140fca00a627 Jun 15 14:51:15.211727 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Name: tempest-AttachVolumeTestJSON-2133096874-project Jun 15 14:51:15.211727 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: method: > Jun 15 14:51:15.211727 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: exception: Instance 614be0bb-764c-4e45-ab82-656b13ded3bb could not be found. Jun 15 14:51:15.211727 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: action_args: {'id': '614be0bb-764c-4e45-ab82-656b13ded3bb'} Jun 15 14:51:15.212606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:51:15.212606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:15.212606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:51:15.212606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:51:15.212606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:51:15.212606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:51:15.212606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:51:15.212606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:51:15.212606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:51:15.212606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:51:15.212606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 614be0bb-764c-4e45-ab82-656b13ded3bb could not be found. Jun 15 14:51:15.212606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:15.212606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:15.212606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:15.212606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:15.212606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:15.212606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:15.212606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:51:15.212606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:51:15.212606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:51:15.214100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:51:15.214100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 14:51:15.214100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 14:51:15.214100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 14:51:15.214100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 14:51:15.214100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:51:15.214100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:51:15.214100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:51:15.214100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:51:15.214100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 614be0bb-764c-4e45-ab82-656b13ded3bb could not be found. Jun 15 14:51:15.214100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:15.214100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:15.214100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:15.214100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:15.214100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:15.214100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:15.214100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:51:15.214100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:51:15.214100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 614be0bb-764c-4e45-ab82-656b13ded3bb could not be found. Jun 15 14:51:15.214100 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:15.215642 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-7f2ad942-4530-443f-8695-84dcbc54491a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Returning 404 to user: Instance 614be0bb-764c-4e45-ab82-656b13ded3bb could not be found. {{(pid=124220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:51:15.215642 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-7f2ad942-4530-443f-8695-84dcbc54491a tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "DELETE /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb" status: 404 len: 111 microversion: 2.1 time: 0.029340 Jun 15 14:51:15.215642 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 482/990] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:51:15 2022] DELETE /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:51:15.220244 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-75e89d5f-e4ef-4af6-b45c-b0219c44febc tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:15.221990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-75e89d5f-e4ef-4af6-b45c-b0219c44febc tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 614be0bb-764c-4e45-ab82-656b13ded3bb] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:15.231352 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-75e89d5f-e4ef-4af6-b45c-b0219c44febc tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:15.231799 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-75e89d5f-e4ef-4af6-b45c-b0219c44febc tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:15.232554 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-75e89d5f-e4ef-4af6-b45c-b0219c44febc tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:15.232986 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-75e89d5f-e4ef-4af6-b45c-b0219c44febc tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:15.246337 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-75e89d5f-e4ef-4af6-b45c-b0219c44febc tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] HTTP exception thrown: Instance 614be0bb-764c-4e45-ab82-656b13ded3bb could not be found. Jun 15 14:51:15.247957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-75e89d5f-e4ef-4af6-b45c-b0219c44febc tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Request method failure captured: Jun 15 14:51:15.247957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb HTTP/1.1 Jun 15 14:51:15.247957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:51:15.247957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:51:15.247957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:51:15.247957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:51:15.247957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:51:15.247957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:51:15.247957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:51:15.247957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:51:15.247957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfAJbOMAn4uuMkObo-mKlEXE2sBkt8BVXSXuSs2-tUHPjy235pz3ZfhHF4IXCVW6sAR2sfQIWe12-EdW2FzfFNe8sHSOX5z1Z169ZX9Np5yjTEqN-R545Wm35ZLsEh7ox97tPIOOrfTYdJHHGByAhvQkLnH24ukI9ee6odfAZSUkUuw Jun 15 14:51:15.247957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:51:15.247957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:51:15.247957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:51:15.247957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:51:15.247957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:51:15.247957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:51:15.247957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 0c12c8e1398843eca8746543a0684841 Jun 15 14:51:15.247957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-AttachVolumeTestJSON-2133096874 Jun 15 14:51:15.247957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:51:15.247957 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:51:15.249480 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0c12c8e1398843eca8746543a0684841"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0c12c8e1398843eca8746543a0684841", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0c12c8e1398843eca8746543a0684841"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0c12c8e1398843eca8746543a0684841"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:51:15.249480 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-AttachVolumeTestJSON-2133096874 Jun 15 14:51:15.249480 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 0c12c8e1398843eca8746543a0684841 Jun 15 14:51:15.249480 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2133096874 Jun 15 14:51:15.249480 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-AttachVolumeTestJSON-2133096874-project Jun 15 14:51:15.249480 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:51:15.249480 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:51:15.249480 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 28ff37865a9b49ec8601140fca00a627 Jun 15 14:51:15.249480 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-AttachVolumeTestJSON-2133096874-project Jun 15 14:51:15.249480 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:51:15.249480 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Instance 614be0bb-764c-4e45-ab82-656b13ded3bb could not be found. Jun 15 14:51:15.249480 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': '614be0bb-764c-4e45-ab82-656b13ded3bb'} Jun 15 14:51:15.250409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:51:15.250409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:15.250409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:51:15.250409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:51:15.250409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:51:15.250409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:51:15.250409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:51:15.250409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:51:15.250409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:51:15.250409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:51:15.250409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 614be0bb-764c-4e45-ab82-656b13ded3bb could not be found. Jun 15 14:51:15.250409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:15.250409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:15.250409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:15.250409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:15.250409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:15.250409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:15.250409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:51:15.250409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:51:15.250409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:51:15.252166 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:51:15.252166 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:51:15.252166 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:51:15.252166 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:51:15.252166 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:51:15.252166 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:51:15.252166 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:51:15.252166 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 614be0bb-764c-4e45-ab82-656b13ded3bb could not be found. Jun 15 14:51:15.252166 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:15.252166 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:15.252166 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:15.252166 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:15.252166 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:15.252166 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:15.252166 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:51:15.252166 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:51:15.252166 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 614be0bb-764c-4e45-ab82-656b13ded3bb could not be found. Jun 15 14:51:15.252166 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:15.253500 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-75e89d5f-e4ef-4af6-b45c-b0219c44febc tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Returning 404 to user: Instance 614be0bb-764c-4e45-ab82-656b13ded3bb could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:51:15.253500 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-75e89d5f-e4ef-4af6-b45c-b0219c44febc tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb" status: 404 len: 111 microversion: 2.1 time: 0.033397 Jun 15 14:51:15.253500 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 509/991] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:15 2022] GET /compute/v2.1/servers/614be0bb-764c-4e45-ab82-656b13ded3bb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:51:16.384863 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-882e62e7-0e43-401f-9274-f88052948718 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:16.385351 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-882e62e7-0e43-401f-9274-f88052948718 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:16.391900 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-882e62e7-0e43-401f-9274-f88052948718 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:16.392354 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-882e62e7-0e43-401f-9274-f88052948718 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:16.393739 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-882e62e7-0e43-401f-9274-f88052948718 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:16.394380 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-882e62e7-0e43-401f-9274-f88052948718 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:16.407814 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.wsgi [None req-882e62e7-0e43-401f-9274-f88052948718 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] HTTP exception thrown: Instance 401c9feb-30ca-4df6-9fba-0a05da5dce7b could not be found. Jun 15 14:51:16.409395 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-882e62e7-0e43-401f-9274-f88052948718 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Request method failure captured: Jun 15 14:51:16.409395 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: request: DELETE /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b HTTP/1.1 Jun 15 14:51:16.409395 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept: application/json Jun 15 14:51:16.409395 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept-Encoding: identity Jun 15 14:51:16.409395 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Connection: close Jun 15 14:51:16.409395 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Length: 0 Jun 15 14:51:16.409395 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Type: application/json Jun 15 14:51:16.409395 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Host: 10.222.0.57 Jun 15 14:51:16.409395 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Openstack-System-Scope: None Jun 15 14:51:16.409395 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: User-Agent: python-urllib3/1.26.9 Jun 15 14:51:16.409395 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Auth-Token: gAAAAABiqfAJbOMAn4uuMkObo-mKlEXE2sBkt8BVXSXuSs2-tUHPjy235pz3ZfhHF4IXCVW6sAR2sfQIWe12-EdW2FzfFNe8sHSOX5z1Z169ZX9Np5yjTEqN-R545Wm35ZLsEh7ox97tPIOOrfTYdJHHGByAhvQkLnH24ukI9ee6odfAZSUkUuw Jun 15 14:51:16.409395 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Id: None Jun 15 14:51:16.409395 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Name: None Jun 15 14:51:16.409395 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Identity-Status: Confirmed Jun 15 14:51:16.409395 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Is-Admin-Project: True Jun 15 14:51:16.409395 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Id: default Jun 15 14:51:16.409395 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Name: Default Jun 15 14:51:16.409395 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Id: 0c12c8e1398843eca8746543a0684841 Jun 15 14:51:16.409395 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Name: tempest-AttachVolumeTestJSON-2133096874 Jun 15 14:51:16.409395 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Role: member,reader Jun 15 14:51:16.409395 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Roles: member,reader Jun 15 14:51:16.410975 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0c12c8e1398843eca8746543a0684841"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0c12c8e1398843eca8746543a0684841", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0c12c8e1398843eca8746543a0684841"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0c12c8e1398843eca8746543a0684841"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:51:16.410975 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant: tempest-AttachVolumeTestJSON-2133096874 Jun 15 14:51:16.410975 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Id: 0c12c8e1398843eca8746543a0684841 Jun 15 14:51:16.410975 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2133096874 Jun 15 14:51:16.410975 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User: tempest-AttachVolumeTestJSON-2133096874-project Jun 15 14:51:16.410975 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Id: default Jun 15 14:51:16.410975 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Name: Default Jun 15 14:51:16.410975 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Id: 28ff37865a9b49ec8601140fca00a627 Jun 15 14:51:16.410975 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Name: tempest-AttachVolumeTestJSON-2133096874-project Jun 15 14:51:16.410975 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: method: > Jun 15 14:51:16.410975 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: exception: Instance 401c9feb-30ca-4df6-9fba-0a05da5dce7b could not be found. Jun 15 14:51:16.410975 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: action_args: {'id': '401c9feb-30ca-4df6-9fba-0a05da5dce7b'} Jun 15 14:51:16.411830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:51:16.411830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:16.411830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:51:16.411830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:51:16.411830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:51:16.411830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:51:16.411830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:51:16.411830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:51:16.411830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:51:16.411830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:51:16.411830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 401c9feb-30ca-4df6-9fba-0a05da5dce7b could not be found. Jun 15 14:51:16.411830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:16.411830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:16.411830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:16.411830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:16.411830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:16.411830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:16.411830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:51:16.411830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:51:16.411830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:51:16.413265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:51:16.413265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 14:51:16.413265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 14:51:16.413265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 14:51:16.413265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 14:51:16.413265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:51:16.413265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:51:16.413265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:51:16.413265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:51:16.413265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 401c9feb-30ca-4df6-9fba-0a05da5dce7b could not be found. Jun 15 14:51:16.413265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:16.413265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:16.413265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:16.413265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:16.413265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:16.413265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:16.413265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:51:16.413265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:51:16.413265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 401c9feb-30ca-4df6-9fba-0a05da5dce7b could not be found. Jun 15 14:51:16.413265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:16.415077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-882e62e7-0e43-401f-9274-f88052948718 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Returning 404 to user: Instance 401c9feb-30ca-4df6-9fba-0a05da5dce7b could not be found. {{(pid=124220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:51:16.415077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-882e62e7-0e43-401f-9274-f88052948718 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "DELETE /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 404 len: 111 microversion: 2.1 time: 0.029960 Jun 15 14:51:16.415077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 483/992] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:51:16 2022] DELETE /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:51:16.419110 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-ad2e9b91-256a-4bf1-89e7-42afcfae15d0 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:16.419745 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-ad2e9b91-256a-4bf1-89e7-42afcfae15d0 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] [instance: 401c9feb-30ca-4df6-9fba-0a05da5dce7b] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:16.426475 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ad2e9b91-256a-4bf1-89e7-42afcfae15d0 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:16.426925 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ad2e9b91-256a-4bf1-89e7-42afcfae15d0 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:16.427687 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ad2e9b91-256a-4bf1-89e7-42afcfae15d0 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:16.428125 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ad2e9b91-256a-4bf1-89e7-42afcfae15d0 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:16.441692 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-ad2e9b91-256a-4bf1-89e7-42afcfae15d0 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] HTTP exception thrown: Instance 401c9feb-30ca-4df6-9fba-0a05da5dce7b could not be found. Jun 15 14:51:16.443196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-ad2e9b91-256a-4bf1-89e7-42afcfae15d0 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Request method failure captured: Jun 15 14:51:16.443196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b HTTP/1.1 Jun 15 14:51:16.443196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:51:16.443196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:51:16.443196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:51:16.443196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:51:16.443196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:51:16.443196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:51:16.443196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:51:16.443196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:51:16.443196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfAJbOMAn4uuMkObo-mKlEXE2sBkt8BVXSXuSs2-tUHPjy235pz3ZfhHF4IXCVW6sAR2sfQIWe12-EdW2FzfFNe8sHSOX5z1Z169ZX9Np5yjTEqN-R545Wm35ZLsEh7ox97tPIOOrfTYdJHHGByAhvQkLnH24ukI9ee6odfAZSUkUuw Jun 15 14:51:16.443196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:51:16.443196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:51:16.443196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:51:16.443196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:51:16.443196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:51:16.443196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:51:16.443196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 0c12c8e1398843eca8746543a0684841 Jun 15 14:51:16.443196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-AttachVolumeTestJSON-2133096874 Jun 15 14:51:16.443196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:51:16.443196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:51:16.444741 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0c12c8e1398843eca8746543a0684841"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0c12c8e1398843eca8746543a0684841", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0c12c8e1398843eca8746543a0684841"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0c12c8e1398843eca8746543a0684841"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:51:16.444741 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-AttachVolumeTestJSON-2133096874 Jun 15 14:51:16.444741 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 0c12c8e1398843eca8746543a0684841 Jun 15 14:51:16.444741 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2133096874 Jun 15 14:51:16.444741 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-AttachVolumeTestJSON-2133096874-project Jun 15 14:51:16.444741 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:51:16.444741 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:51:16.444741 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 28ff37865a9b49ec8601140fca00a627 Jun 15 14:51:16.444741 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-AttachVolumeTestJSON-2133096874-project Jun 15 14:51:16.444741 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:51:16.444741 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Instance 401c9feb-30ca-4df6-9fba-0a05da5dce7b could not be found. Jun 15 14:51:16.444741 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': '401c9feb-30ca-4df6-9fba-0a05da5dce7b'} Jun 15 14:51:16.445571 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:51:16.445571 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:16.445571 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:51:16.445571 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:51:16.445571 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:51:16.445571 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:51:16.445571 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:51:16.445571 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:51:16.445571 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:51:16.445571 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:51:16.445571 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 401c9feb-30ca-4df6-9fba-0a05da5dce7b could not be found. Jun 15 14:51:16.445571 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:16.445571 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:16.445571 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:16.445571 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:16.445571 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:16.445571 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:16.445571 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:51:16.445571 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:51:16.445571 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:51:16.447123 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:51:16.447123 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:51:16.447123 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:51:16.447123 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:51:16.447123 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:51:16.447123 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:51:16.447123 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:51:16.447123 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 401c9feb-30ca-4df6-9fba-0a05da5dce7b could not be found. Jun 15 14:51:16.447123 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:16.447123 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:16.447123 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:16.447123 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:16.447123 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:16.447123 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:16.447123 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:51:16.447123 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:51:16.447123 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 401c9feb-30ca-4df6-9fba-0a05da5dce7b could not be found. Jun 15 14:51:16.447123 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:16.448411 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-ad2e9b91-256a-4bf1-89e7-42afcfae15d0 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] Returning 404 to user: Instance 401c9feb-30ca-4df6-9fba-0a05da5dce7b could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:51:16.448411 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-ad2e9b91-256a-4bf1-89e7-42afcfae15d0 tempest-AttachVolumeTestJSON-2133096874 tempest-AttachVolumeTestJSON-2133096874-project] 10.222.0.57 "GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b" status: 404 len: 111 microversion: 2.1 time: 0.029342 Jun 15 14:51:16.448411 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 510/993] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:16 2022] GET /compute/v2.1/servers/401c9feb-30ca-4df6-9fba-0a05da5dce7b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:51:20.532360 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c585fff3-67f9-476f-8611-f44aecfdbe86 tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] Action: 'create', calling method: .version_select at 0x7f8f1345f4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1791604755", "metadata": {"Type": "work"}}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:20.556432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c585fff3-67f9-476f-8611-f44aecfdbe86 tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] Request method failure captured: Jun 15 14:51:20.556432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 14:51:20.556432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept: application/json Jun 15 14:51:20.556432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept-Encoding: identity Jun 15 14:51:20.556432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Connection: close Jun 15 14:51:20.556432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Length: 122 Jun 15 14:51:20.556432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Type: application/json Jun 15 14:51:20.556432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Host: 10.222.0.57 Jun 15 14:51:20.556432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Openstack-System-Scope: None Jun 15 14:51:20.556432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: User-Agent: python-urllib3/1.26.9 Jun 15 14:51:20.556432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Auth-Token: gAAAAABiqfHo9KjlQLZzgSz3rnNCKBOD0-LkswYKZ0j7rs_bOfVBeTmGA-UfQUTQEB1YVQ6BQablc6PUPJTpGdM0WHBoKdsq2qXMW3Zb0mZDN3ZNW1effKrXULMFoQ6N34IipXWHJ_jy-pfRneTznQdWWlmTezbdotgyHuoNfQkwt1kiyKnBVEQ Jun 15 14:51:20.556432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Id: None Jun 15 14:51:20.556432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Name: None Jun 15 14:51:20.556432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Identity-Status: Confirmed Jun 15 14:51:20.556432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Is-Admin-Project: True Jun 15 14:51:20.556432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Id: default Jun 15 14:51:20.556432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Name: Default Jun 15 14:51:20.556432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Id: 36ce2c1d9a9f4e5d95e0276769754b03 Jun 15 14:51:20.556432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Name: tempest-VolumesNegativeTest-205138151 Jun 15 14:51:20.556432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Role: member,reader Jun 15 14:51:20.556432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Roles: member,reader Jun 15 14:51:20.558104 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/36ce2c1d9a9f4e5d95e0276769754b03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_36ce2c1d9a9f4e5d95e0276769754b03", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/36ce2c1d9a9f4e5d95e0276769754b03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/36ce2c1d9a9f4e5d95e0276769754b03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:51:20.558104 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant: tempest-VolumesNegativeTest-205138151 Jun 15 14:51:20.558104 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Id: 36ce2c1d9a9f4e5d95e0276769754b03 Jun 15 14:51:20.558104 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Name: tempest-VolumesNegativeTest-205138151 Jun 15 14:51:20.558104 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User: tempest-VolumesNegativeTest-205138151-project Jun 15 14:51:20.558104 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Id: default Jun 15 14:51:20.558104 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Name: Default Jun 15 14:51:20.558104 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Id: 35f264402d884087ac9582ba4791a40b Jun 15 14:51:20.558104 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Name: tempest-VolumesNegativeTest-205138151-project Jun 15 14:51:20.558104 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Jun 15 14:51:20.558104 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1791604755", "metadata": {"Type": "work"}}} Jun 15 14:51:20.558104 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: method: Jun 15 14:51:20.558104 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 14:51:20.559138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1791604755', 'metadata': {'Type': 'work'}}}} Jun 15 14:51:20.559138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:51:20.559138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:20.559138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 14:51:20.559138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 14:51:20.559138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 14:51:20.559138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise error Jun 15 14:51:20.559138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 15 14:51:20.559138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.559138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 15 14:51:20.559138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 14:51:20.559138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.559138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 14:51:20.559138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi '#$%' Jun 15 14:51:20.559138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.559138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:20.559138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.559138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:20.559138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:20.559138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:20.559138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:51:20.559138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:51:20.560967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:51:20.560967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:51:20.560967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:51:20.560967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:51:20.560967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 14:51:20.560967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 14:51:20.560967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 14:51:20.560967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 14:51:20.560967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 14:51:20.560967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 14:51:20.560967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 14:51:20.560967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.560967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:20.560967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.560967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:20.560967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:20.560967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:20.560967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 14:51:20.560967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 14:51:20.562475 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 14:51:20.562475 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.562475 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c585fff3-67f9-476f-8611-f44aecfdbe86 tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:51:20.562475 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-c585fff3-67f9-476f-8611-f44aecfdbe86 tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.139708 Jun 15 14:51:20.562475 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 484/994] 10.222.0.57 () {60 vars in 1155 bytes} [Wed Jun 15 14:51:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 14:51:20.567765 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f61df63a-dad6-4f16-8815-d1b249d0595c tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] Action: 'create', calling method: .version_select at 0x7f8f13dd1f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1183604446", "metadata": {"Type": "work"}}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:20.571013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f61df63a-dad6-4f16-8815-d1b249d0595c tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] Request method failure captured: Jun 15 14:51:20.571013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 14:51:20.571013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:51:20.571013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:51:20.571013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:51:20.571013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 120 Jun 15 14:51:20.571013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:51:20.571013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:51:20.571013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:51:20.571013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:51:20.571013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfHo9KjlQLZzgSz3rnNCKBOD0-LkswYKZ0j7rs_bOfVBeTmGA-UfQUTQEB1YVQ6BQablc6PUPJTpGdM0WHBoKdsq2qXMW3Zb0mZDN3ZNW1effKrXULMFoQ6N34IipXWHJ_jy-pfRneTznQdWWlmTezbdotgyHuoNfQkwt1kiyKnBVEQ Jun 15 14:51:20.571013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:51:20.571013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:51:20.571013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:51:20.571013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:51:20.571013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:51:20.571013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:51:20.571013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 36ce2c1d9a9f4e5d95e0276769754b03 Jun 15 14:51:20.571013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-VolumesNegativeTest-205138151 Jun 15 14:51:20.571013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:51:20.571013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:51:20.572561 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/36ce2c1d9a9f4e5d95e0276769754b03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_36ce2c1d9a9f4e5d95e0276769754b03", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/36ce2c1d9a9f4e5d95e0276769754b03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/36ce2c1d9a9f4e5d95e0276769754b03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:51:20.572561 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-VolumesNegativeTest-205138151 Jun 15 14:51:20.572561 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 36ce2c1d9a9f4e5d95e0276769754b03 Jun 15 14:51:20.572561 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-VolumesNegativeTest-205138151 Jun 15 14:51:20.572561 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-VolumesNegativeTest-205138151-project Jun 15 14:51:20.572561 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:51:20.572561 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:51:20.572561 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 35f264402d884087ac9582ba4791a40b Jun 15 14:51:20.572561 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-VolumesNegativeTest-205138151-project Jun 15 14:51:20.572561 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Jun 15 14:51:20.572561 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1183604446", "metadata": {"Type": "work"}}} Jun 15 14:51:20.572561 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: Jun 15 14:51:20.572561 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 14:51:20.573575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1183604446', 'metadata': {'Type': 'work'}}}} Jun 15 14:51:20.573575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:51:20.573575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:20.573575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 14:51:20.573575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 14:51:20.573575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 14:51:20.573575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise error Jun 15 14:51:20.573575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 15 14:51:20.573575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.573575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 15 14:51:20.573575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 14:51:20.573575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.573575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 14:51:20.573575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi '0' Jun 15 14:51:20.573575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.573575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:20.573575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.573575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:20.573575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:20.573575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:20.573575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:51:20.573575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:51:20.575203 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:51:20.575203 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:51:20.575203 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:51:20.575203 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:51:20.575203 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 14:51:20.575203 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 14:51:20.575203 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 14:51:20.575203 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 14:51:20.575203 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 14:51:20.575203 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 14:51:20.575203 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 14:51:20.575203 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.575203 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:20.575203 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.575203 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:20.575203 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:20.575203 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:20.575203 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 14:51:20.575203 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 14:51:20.576690 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 14:51:20.576690 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.576690 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f61df63a-dad6-4f16-8815-d1b249d0595c tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:51:20.576690 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f61df63a-dad6-4f16-8815-d1b249d0595c tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008623 Jun 15 14:51:20.576690 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 511/995] 10.222.0.57 () {60 vars in 1155 bytes} [Wed Jun 15 14:51:20 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 14:51:20.582377 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-70dd94d2-18ee-424e-86ba-4358cc6a3792 tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] Action: 'create', calling method: .version_select at 0x7f8f134dc0d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-520328853", "metadata": {"Type": "work"}}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:20.585600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-70dd94d2-18ee-424e-86ba-4358cc6a3792 tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] Request method failure captured: Jun 15 14:51:20.585600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 14:51:20.585600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept: application/json Jun 15 14:51:20.585600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept-Encoding: identity Jun 15 14:51:20.585600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Connection: close Jun 15 14:51:20.585600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Length: 118 Jun 15 14:51:20.585600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Type: application/json Jun 15 14:51:20.585600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Host: 10.222.0.57 Jun 15 14:51:20.585600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Openstack-System-Scope: None Jun 15 14:51:20.585600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: User-Agent: python-urllib3/1.26.9 Jun 15 14:51:20.585600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Auth-Token: gAAAAABiqfHo9KjlQLZzgSz3rnNCKBOD0-LkswYKZ0j7rs_bOfVBeTmGA-UfQUTQEB1YVQ6BQablc6PUPJTpGdM0WHBoKdsq2qXMW3Zb0mZDN3ZNW1effKrXULMFoQ6N34IipXWHJ_jy-pfRneTznQdWWlmTezbdotgyHuoNfQkwt1kiyKnBVEQ Jun 15 14:51:20.585600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Id: None Jun 15 14:51:20.585600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Name: None Jun 15 14:51:20.585600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Identity-Status: Confirmed Jun 15 14:51:20.585600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Is-Admin-Project: True Jun 15 14:51:20.585600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Id: default Jun 15 14:51:20.585600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Name: Default Jun 15 14:51:20.585600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Id: 36ce2c1d9a9f4e5d95e0276769754b03 Jun 15 14:51:20.585600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Name: tempest-VolumesNegativeTest-205138151 Jun 15 14:51:20.585600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Role: member,reader Jun 15 14:51:20.585600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Roles: member,reader Jun 15 14:51:20.587187 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/36ce2c1d9a9f4e5d95e0276769754b03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_36ce2c1d9a9f4e5d95e0276769754b03", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/36ce2c1d9a9f4e5d95e0276769754b03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/36ce2c1d9a9f4e5d95e0276769754b03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:51:20.587187 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant: tempest-VolumesNegativeTest-205138151 Jun 15 14:51:20.587187 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Id: 36ce2c1d9a9f4e5d95e0276769754b03 Jun 15 14:51:20.587187 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Name: tempest-VolumesNegativeTest-205138151 Jun 15 14:51:20.587187 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User: tempest-VolumesNegativeTest-205138151-project Jun 15 14:51:20.587187 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Id: default Jun 15 14:51:20.587187 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Name: Default Jun 15 14:51:20.587187 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Id: 35f264402d884087ac9582ba4791a40b Jun 15 14:51:20.587187 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Name: tempest-VolumesNegativeTest-205138151-project Jun 15 14:51:20.587187 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Jun 15 14:51:20.587187 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-520328853", "metadata": {"Type": "work"}}} Jun 15 14:51:20.587187 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: method: Jun 15 14:51:20.587187 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 14:51:20.588152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-520328853', 'metadata': {'Type': 'work'}}}} Jun 15 14:51:20.588152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:51:20.588152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:20.588152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 14:51:20.588152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 14:51:20.588152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 14:51:20.588152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise error Jun 15 14:51:20.588152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 15 14:51:20.588152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.588152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 15 14:51:20.588152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 14:51:20.588152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.588152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 14:51:20.588152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi '' Jun 15 14:51:20.588152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.588152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:20.588152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.588152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:20.588152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:20.588152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:20.588152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:51:20.588152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:51:20.589759 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:51:20.589759 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:51:20.589759 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:51:20.589759 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:51:20.589759 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 14:51:20.589759 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 14:51:20.589759 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 14:51:20.589759 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 14:51:20.589759 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 14:51:20.589759 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 14:51:20.589759 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 14:51:20.589759 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.589759 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:20.589759 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.589759 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:20.589759 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:20.589759 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:20.589759 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 14:51:20.589759 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 14:51:20.590936 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 14:51:20.590936 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.590936 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-70dd94d2-18ee-424e-86ba-4358cc6a3792 tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:51:20.590936 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-70dd94d2-18ee-424e-86ba-4358cc6a3792 tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009333 Jun 15 14:51:20.590936 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 485/996] 10.222.0.57 () {60 vars in 1155 bytes} [Wed Jun 15 14:51:20 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 14:51:20.597069 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-87528c9b-2113-44bb-ad0f-4da5e3131a9d tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] Calling method '.version_select at 0x7f8f20ba69d0>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:20.626248 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-87528c9b-2113-44bb-ad0f-4da5e3131a9d tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] HTTP exception thrown: Volume tempest-invalid-1739614217 could not be found. Jun 15 14:51:20.628827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-87528c9b-2113-44bb-ad0f-4da5e3131a9d tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] Request method failure captured: Jun 15 14:51:20.628827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1739614217 HTTP/1.1 Jun 15 14:51:20.628827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:51:20.628827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:51:20.628827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:51:20.628827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:51:20.628827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:51:20.628827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:51:20.628827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:51:20.628827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:51:20.628827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfHo9KjlQLZzgSz3rnNCKBOD0-LkswYKZ0j7rs_bOfVBeTmGA-UfQUTQEB1YVQ6BQablc6PUPJTpGdM0WHBoKdsq2qXMW3Zb0mZDN3ZNW1effKrXULMFoQ6N34IipXWHJ_jy-pfRneTznQdWWlmTezbdotgyHuoNfQkwt1kiyKnBVEQ Jun 15 14:51:20.628827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:51:20.628827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:51:20.628827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:51:20.628827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:51:20.628827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:51:20.628827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:51:20.628827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 36ce2c1d9a9f4e5d95e0276769754b03 Jun 15 14:51:20.628827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-VolumesNegativeTest-205138151 Jun 15 14:51:20.628827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:51:20.628827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:51:20.630431 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/36ce2c1d9a9f4e5d95e0276769754b03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_36ce2c1d9a9f4e5d95e0276769754b03", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/36ce2c1d9a9f4e5d95e0276769754b03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/36ce2c1d9a9f4e5d95e0276769754b03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:51:20.630431 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-VolumesNegativeTest-205138151 Jun 15 14:51:20.630431 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 36ce2c1d9a9f4e5d95e0276769754b03 Jun 15 14:51:20.630431 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-VolumesNegativeTest-205138151 Jun 15 14:51:20.630431 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-VolumesNegativeTest-205138151-project Jun 15 14:51:20.630431 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:51:20.630431 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:51:20.630431 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 35f264402d884087ac9582ba4791a40b Jun 15 14:51:20.630431 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-VolumesNegativeTest-205138151-project Jun 15 14:51:20.630431 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: Jun 15 14:51:20.630431 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Volume tempest-invalid-1739614217 could not be found. Jun 15 14:51:20.630431 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': 'tempest-invalid-1739614217'} Jun 15 14:51:20.630431 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:51:20.631377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:20.631377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:51:20.631377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:51:20.631377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 14:51:20.631377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 14:51:20.631377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 14:51:20.631377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 14:51:20.631377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 14:51:20.631377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 14:51:20.631377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 14:51:20.631377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 14:51:20.631377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:51:20.631377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:51:20.631377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:51:20.631377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:51:20.631377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1739614217 could not be found. (HTTP 404) (Request-ID: req-885178d0-074a-429d-af05-f40617b8d182) Jun 15 14:51:20.631377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.631377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:20.631377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.632769 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:20.632769 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 14:51:20.632769 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 14:51:20.632769 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 14:51:20.632769 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 14:51:20.632769 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 14:51:20.632769 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 14:51:20.632769 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 14:51:20.632769 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 14:51:20.632769 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:51:20.632769 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:51:20.632769 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 14:51:20.632769 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 14:51:20.632769 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 14:51:20.632769 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 14:51:20.632769 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 14:51:20.632769 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 14:51:20.632769 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 14:51:20.632769 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 14:51:20.634148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:51:20.634148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:51:20.634148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:51:20.634148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:51:20.634148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1739614217 could not be found. Jun 15 14:51:20.634148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.634148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:20.634148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.634148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:20.634148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:20.634148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:20.634148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:51:20.634148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:51:20.634148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:51:20.634148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:51:20.634148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:51:20.634148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:51:20.634148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 14:51:20.634148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:51:20.634148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1739614217 could not be found. Jun 15 14:51:20.635536 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.635536 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:20.635536 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.635536 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:20.635536 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:20.635536 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:20.635536 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:51:20.635536 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:51:20.635536 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1739614217 could not be found. Jun 15 14:51:20.635536 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.635536 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-87528c9b-2113-44bb-ad0f-4da5e3131a9d tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] Returning 404 to user: Volume tempest-invalid-1739614217 could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:51:20.635536 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-87528c9b-2113-44bb-ad0f-4da5e3131a9d tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1739614217" status: 404 len: 99 microversion: 2.1 time: 0.038220 Jun 15 14:51:20.635536 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 512/997] 10.222.0.57 () {58 vars in 1217 bytes} [Wed Jun 15 14:51:20 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1739614217 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 15 14:51:20.639696 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-4d26741b-a05c-4b92-a2d1-05fb0aeea913 tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003732 Jun 15 14:51:20.640187 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 486/998] 10.222.0.57 () {58 vars in 1139 bytes} [Wed Jun 15 14:51:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 15 14:51:20.648912 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-64ebc0ee-4758-40e8-aa29-7043790b9f3f tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003692 Jun 15 14:51:20.650086 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 513/999] 10.222.0.57 () {58 vars in 1136 bytes} [Wed Jun 15 14:51:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 15 14:51:20.658671 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-2e8c1778-4f6d-41d5-864c-135fff83b60f tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] Calling method '.version_select at 0x7f8f136724c0>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:20.685926 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.wsgi [None req-2e8c1778-4f6d-41d5-864c-135fff83b60f tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] HTTP exception thrown: Volume 4b8a25d8-3121-40a9-a7d9-7402d0a0252d could not be found. Jun 15 14:51:20.687958 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-2e8c1778-4f6d-41d5-864c-135fff83b60f tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] Request method failure captured: Jun 15 14:51:20.687958 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: request: DELETE /compute/v2.1/os-volumes/4b8a25d8-3121-40a9-a7d9-7402d0a0252d HTTP/1.1 Jun 15 14:51:20.687958 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept: application/json Jun 15 14:51:20.687958 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept-Encoding: identity Jun 15 14:51:20.687958 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Connection: close Jun 15 14:51:20.687958 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Length: 0 Jun 15 14:51:20.687958 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Type: application/json Jun 15 14:51:20.687958 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Host: 10.222.0.57 Jun 15 14:51:20.687958 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Openstack-System-Scope: None Jun 15 14:51:20.687958 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: User-Agent: python-urllib3/1.26.9 Jun 15 14:51:20.687958 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Auth-Token: gAAAAABiqfHo9KjlQLZzgSz3rnNCKBOD0-LkswYKZ0j7rs_bOfVBeTmGA-UfQUTQEB1YVQ6BQablc6PUPJTpGdM0WHBoKdsq2qXMW3Zb0mZDN3ZNW1effKrXULMFoQ6N34IipXWHJ_jy-pfRneTznQdWWlmTezbdotgyHuoNfQkwt1kiyKnBVEQ Jun 15 14:51:20.687958 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Id: None Jun 15 14:51:20.687958 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Name: None Jun 15 14:51:20.687958 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Identity-Status: Confirmed Jun 15 14:51:20.687958 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Is-Admin-Project: True Jun 15 14:51:20.687958 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Id: default Jun 15 14:51:20.687958 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Name: Default Jun 15 14:51:20.687958 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Id: 36ce2c1d9a9f4e5d95e0276769754b03 Jun 15 14:51:20.687958 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Name: tempest-VolumesNegativeTest-205138151 Jun 15 14:51:20.687958 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Role: member,reader Jun 15 14:51:20.687958 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Roles: member,reader Jun 15 14:51:20.689505 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/36ce2c1d9a9f4e5d95e0276769754b03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_36ce2c1d9a9f4e5d95e0276769754b03", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/36ce2c1d9a9f4e5d95e0276769754b03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/36ce2c1d9a9f4e5d95e0276769754b03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:51:20.689505 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant: tempest-VolumesNegativeTest-205138151 Jun 15 14:51:20.689505 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Id: 36ce2c1d9a9f4e5d95e0276769754b03 Jun 15 14:51:20.689505 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Name: tempest-VolumesNegativeTest-205138151 Jun 15 14:51:20.689505 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User: tempest-VolumesNegativeTest-205138151-project Jun 15 14:51:20.689505 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Id: default Jun 15 14:51:20.689505 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Name: Default Jun 15 14:51:20.689505 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Id: 35f264402d884087ac9582ba4791a40b Jun 15 14:51:20.689505 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Name: tempest-VolumesNegativeTest-205138151-project Jun 15 14:51:20.689505 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: method: Jun 15 14:51:20.689505 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: exception: Volume 4b8a25d8-3121-40a9-a7d9-7402d0a0252d could not be found. Jun 15 14:51:20.689505 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: action_args: {'id': '4b8a25d8-3121-40a9-a7d9-7402d0a0252d'} Jun 15 14:51:20.689505 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:51:20.690920 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:20.690920 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:51:20.690920 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:51:20.690920 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 14:51:20.690920 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 14:51:20.690920 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 14:51:20.690920 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 14:51:20.690920 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 14:51:20.690920 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 14:51:20.690920 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 14:51:20.690920 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 14:51:20.690920 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:51:20.690920 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:51:20.690920 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:51:20.690920 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:51:20.690920 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4b8a25d8-3121-40a9-a7d9-7402d0a0252d could not be found. (HTTP 404) (Request-ID: req-e865a8bd-dc30-46e9-b5ab-3d82ba31d955) Jun 15 14:51:20.690920 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.690920 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:20.690920 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.692151 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:20.692151 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 14:51:20.692151 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 14:51:20.692151 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 14:51:20.692151 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 14:51:20.692151 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 14:51:20.692151 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 14:51:20.692151 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 14:51:20.692151 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 14:51:20.692151 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:51:20.692151 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:51:20.692151 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 14:51:20.692151 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 14:51:20.692151 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 14:51:20.692151 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 14:51:20.692151 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 14:51:20.692151 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 14:51:20.692151 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 14:51:20.692151 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 14:51:20.693522 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:51:20.693522 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:51:20.693522 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:51:20.693522 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:51:20.693522 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4b8a25d8-3121-40a9-a7d9-7402d0a0252d could not be found. Jun 15 14:51:20.693522 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.693522 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:20.693522 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.693522 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:20.693522 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:20.693522 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:20.693522 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:51:20.693522 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:51:20.693522 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:51:20.693522 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:51:20.693522 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:51:20.693522 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:51:20.693522 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 14:51:20.693522 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:51:20.694938 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4b8a25d8-3121-40a9-a7d9-7402d0a0252d could not be found. Jun 15 14:51:20.694938 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.694938 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:20.694938 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.694938 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:20.694938 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:20.694938 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:20.694938 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:51:20.694938 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:51:20.694938 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4b8a25d8-3121-40a9-a7d9-7402d0a0252d could not be found. Jun 15 14:51:20.694938 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.694938 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-2e8c1778-4f6d-41d5-864c-135fff83b60f tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] Returning 404 to user: Volume 4b8a25d8-3121-40a9-a7d9-7402d0a0252d could not be found. {{(pid=124220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:51:20.694938 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-2e8c1778-4f6d-41d5-864c-135fff83b60f tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/4b8a25d8-3121-40a9-a7d9-7402d0a0252d" status: 404 len: 109 microversion: 2.1 time: 0.034478 Jun 15 14:51:20.694938 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 487/1000] 10.222.0.57 () {58 vars in 1247 bytes} [Wed Jun 15 14:51:20 2022] DELETE /compute/v2.1/os-volumes/4b8a25d8-3121-40a9-a7d9-7402d0a0252d => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:51:20.700536 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-b2fdc84d-0d27-456b-8a21-2354fc4c627c tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] Calling method '.version_select at 0x7f8f13dd1c10>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:20.728367 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-b2fdc84d-0d27-456b-8a21-2354fc4c627c tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] HTTP exception thrown: Volume 307e3353-4492-4ac3-b561-3bb5b2f5da2a could not be found. Jun 15 14:51:20.730322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-b2fdc84d-0d27-456b-8a21-2354fc4c627c tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] Request method failure captured: Jun 15 14:51:20.730322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: GET /compute/v2.1/os-volumes/307e3353-4492-4ac3-b561-3bb5b2f5da2a HTTP/1.1 Jun 15 14:51:20.730322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:51:20.730322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:51:20.730322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:51:20.730322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:51:20.730322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:51:20.730322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:51:20.730322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:51:20.730322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:51:20.730322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfHo9KjlQLZzgSz3rnNCKBOD0-LkswYKZ0j7rs_bOfVBeTmGA-UfQUTQEB1YVQ6BQablc6PUPJTpGdM0WHBoKdsq2qXMW3Zb0mZDN3ZNW1effKrXULMFoQ6N34IipXWHJ_jy-pfRneTznQdWWlmTezbdotgyHuoNfQkwt1kiyKnBVEQ Jun 15 14:51:20.730322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:51:20.730322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:51:20.730322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:51:20.730322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:51:20.730322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:51:20.730322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:51:20.730322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 36ce2c1d9a9f4e5d95e0276769754b03 Jun 15 14:51:20.730322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-VolumesNegativeTest-205138151 Jun 15 14:51:20.730322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:51:20.730322 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:51:20.731845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/36ce2c1d9a9f4e5d95e0276769754b03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_36ce2c1d9a9f4e5d95e0276769754b03", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/36ce2c1d9a9f4e5d95e0276769754b03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/36ce2c1d9a9f4e5d95e0276769754b03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:51:20.731845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-VolumesNegativeTest-205138151 Jun 15 14:51:20.731845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 36ce2c1d9a9f4e5d95e0276769754b03 Jun 15 14:51:20.731845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-VolumesNegativeTest-205138151 Jun 15 14:51:20.731845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-VolumesNegativeTest-205138151-project Jun 15 14:51:20.731845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:51:20.731845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:51:20.731845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 35f264402d884087ac9582ba4791a40b Jun 15 14:51:20.731845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-VolumesNegativeTest-205138151-project Jun 15 14:51:20.731845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: Jun 15 14:51:20.731845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Volume 307e3353-4492-4ac3-b561-3bb5b2f5da2a could not be found. Jun 15 14:51:20.731845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': '307e3353-4492-4ac3-b561-3bb5b2f5da2a'} Jun 15 14:51:20.731845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:51:20.732939 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:20.732939 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:51:20.732939 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:51:20.732939 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 14:51:20.732939 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 14:51:20.732939 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 14:51:20.732939 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 14:51:20.732939 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:51:20.732939 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:51:20.732939 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:51:20.732939 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:51:20.732939 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:51:20.732939 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:51:20.732939 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:51:20.732939 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:51:20.732939 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 307e3353-4492-4ac3-b561-3bb5b2f5da2a could not be found. (HTTP 404) (Request-ID: req-defbdb77-f290-4773-af73-391e30372c4b) Jun 15 14:51:20.732939 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.732939 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:20.732939 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.734393 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:20.734393 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 14:51:20.734393 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 14:51:20.734393 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 14:51:20.734393 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 14:51:20.734393 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 14:51:20.734393 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 14:51:20.734393 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 14:51:20.734393 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 14:51:20.734393 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:51:20.734393 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:51:20.734393 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 14:51:20.734393 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 14:51:20.734393 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 14:51:20.734393 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 14:51:20.734393 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:51:20.734393 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:51:20.734393 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:51:20.734393 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:51:20.736795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:51:20.736795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:51:20.736795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:51:20.736795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:51:20.736795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 307e3353-4492-4ac3-b561-3bb5b2f5da2a could not be found. Jun 15 14:51:20.736795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.736795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:20.736795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.736795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:20.736795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:20.736795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:20.736795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:51:20.736795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:51:20.736795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:51:20.736795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:51:20.736795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:51:20.736795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:51:20.736795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 14:51:20.736795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:51:20.738142 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 307e3353-4492-4ac3-b561-3bb5b2f5da2a could not be found. Jun 15 14:51:20.738142 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.738142 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:20.738142 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.738142 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:20.738142 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:20.738142 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:20.738142 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:51:20.738142 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:51:20.738142 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 307e3353-4492-4ac3-b561-3bb5b2f5da2a could not be found. Jun 15 14:51:20.738142 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:20.738142 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-b2fdc84d-0d27-456b-8a21-2354fc4c627c tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] Returning 404 to user: Volume 307e3353-4492-4ac3-b561-3bb5b2f5da2a could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:51:20.738142 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-b2fdc84d-0d27-456b-8a21-2354fc4c627c tempest-VolumesNegativeTest-205138151 tempest-VolumesNegativeTest-205138151-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/307e3353-4492-4ac3-b561-3bb5b2f5da2a" status: 404 len: 109 microversion: 2.1 time: 0.034973 Jun 15 14:51:20.738142 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 514/1001] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Jun 15 14:51:20 2022] GET /compute/v2.1/os-volumes/307e3353-4492-4ac3-b561-3bb5b2f5da2a => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:51:32.860006 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=5 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:32.860791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:32.867200 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-cc6e28a8-f632-48df-b1d2-3d5229ccae78 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1091333924", "imageRef": "e18802bf-9dac-462c-88ba-5cce79043279", "flavorRef": "452", "networks": [{"uuid": "0e570314-2b56-4138-8452-bfcbf1b594cc"}]}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:32.921176 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.network.neutron [None req-cc6e28a8-f632-48df-b1d2-3d5229ccae78 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] validate_networks() for [('0e570314-2b56-4138-8452-bfcbf1b594cc', None, None, None, None, None)] {{(pid=124220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:51:33.259807 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-cc6e28a8-f632-48df-b1d2-3d5229ccae78 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Flavor limits 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:51:33.260241 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-cc6e28a8-f632-48df-b1d2-3d5229ccae78 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Image limits 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:51:33.260722 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-cc6e28a8-f632-48df-b1d2-3d5229ccae78 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Flavor pref 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:51:33.261168 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-cc6e28a8-f632-48df-b1d2-3d5229ccae78 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Image pref 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:51:33.261591 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-cc6e28a8-f632-48df-b1d2-3d5229ccae78 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:51:33.270839 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cc6e28a8-f632-48df-b1d2-3d5229ccae78 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:33.271450 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cc6e28a8-f632-48df-b1d2-3d5229ccae78 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:33.272303 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cc6e28a8-f632-48df-b1d2-3d5229ccae78 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:33.272743 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cc6e28a8-f632-48df-b1d2-3d5229ccae78 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:33.290602 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-cc6e28a8-f632-48df-b1d2-3d5229ccae78 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Getting quotas for project 8d40b771f30d4e668e0c908fbd0da517. Resources: {'cores', 'instances', 'ram'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:51:33.294500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-cc6e28a8-f632-48df-b1d2-3d5229ccae78 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Getting quotas for user 44f839b774b249dd9d7d3061feb2cd41 and project 8d40b771f30d4e668e0c908fbd0da517. Resources: {'cores', 'instances', 'ram'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:51:33.305775 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-cc6e28a8-f632-48df-b1d2-3d5229ccae78 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Going to run 1 instances... {{(pid=124220) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:51:33.308026 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-cc6e28a8-f632-48df-b1d2-3d5229ccae78 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 23c86dd2-372e-4d01-a22b-b311dcfe9811] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e18802bf-9dac-462c-88ba-5cce79043279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:51:33.354326 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-cc6e28a8-f632-48df-b1d2-3d5229ccae78 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.495457 Jun 15 14:51:33.354967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 488/1002] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 14:51:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:51:33.362341 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:33.363557 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:33.369174 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f9b5af1d-9737-4d5c-80ad-f84ec070c03a tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:33.369908 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f9b5af1d-9737-4d5c-80ad-f84ec070c03a tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 23c86dd2-372e-4d01-a22b-b311dcfe9811] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:33.428791 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f9b5af1d-9737-4d5c-80ad-f84ec070c03a tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:33.435530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f9b5af1d-9737-4d5c-80ad-f84ec070c03a tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811" status: 200 len: 1214 microversion: 2.1 time: 0.074596 Jun 15 14:51:33.436082 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 515/1003] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:33 2022] GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:34.455372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-5542b526-03a9-4c0b-a8ff-7d7075b10b87 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:34.456073 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-5542b526-03a9-4c0b-a8ff-7d7075b10b87 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 23c86dd2-372e-4d01-a22b-b311dcfe9811] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:34.464724 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5542b526-03a9-4c0b-a8ff-7d7075b10b87 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:34.465180 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5542b526-03a9-4c0b-a8ff-7d7075b10b87 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:34.466001 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5542b526-03a9-4c0b-a8ff-7d7075b10b87 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:34.466445 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5542b526-03a9-4c0b-a8ff-7d7075b10b87 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:34.528342 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-5542b526-03a9-4c0b-a8ff-7d7075b10b87 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:34.535753 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-5542b526-03a9-4c0b-a8ff-7d7075b10b87 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811" status: 200 len: 1266 microversion: 2.1 time: 0.087255 Jun 15 14:51:34.536889 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 489/1004] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:34 2022] GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:35.553829 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-05d87fa3-cd12-4ff8-b0c9-aeb5969467bf tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:35.554455 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-05d87fa3-cd12-4ff8-b0c9-aeb5969467bf tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 23c86dd2-372e-4d01-a22b-b311dcfe9811] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:35.562930 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-05d87fa3-cd12-4ff8-b0c9-aeb5969467bf tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:35.563396 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-05d87fa3-cd12-4ff8-b0c9-aeb5969467bf tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:35.564184 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-05d87fa3-cd12-4ff8-b0c9-aeb5969467bf tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:35.564625 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-05d87fa3-cd12-4ff8-b0c9-aeb5969467bf tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:35.700353 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-05d87fa3-cd12-4ff8-b0c9-aeb5969467bf tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:35.708703 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-05d87fa3-cd12-4ff8-b0c9-aeb5969467bf tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811" status: 200 len: 1314 microversion: 2.1 time: 0.158617 Jun 15 14:51:35.709291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 516/1005] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:35 2022] GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:36.224130 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-2c804ac7-e95c-41e0-98b8-e13ae2698485 req-59590f7b-784b-439f-8dc5-476b06762656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23c86dd2-372e-4d01-a22b-b311dcfe9811", "tag": "8f37e6a6-5dc0-476c-a48d-6f3171ac20f1"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:36.234159 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-2c804ac7-e95c-41e0-98b8-e13ae2698485 req-59590f7b-784b-439f-8dc5-476b06762656 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:36.234600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-2c804ac7-e95c-41e0-98b8-e13ae2698485 req-59590f7b-784b-439f-8dc5-476b06762656 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:36.246684 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-2c804ac7-e95c-41e0-98b8-e13ae2698485 req-59590f7b-784b-439f-8dc5-476b06762656 service nova] Creating event network-changed:8f37e6a6-5dc0-476c-a48d-6f3171ac20f1 for instance 23c86dd2-372e-4d01-a22b-b311dcfe9811 on hv-cinder-84327 Jun 15 14:51:36.251439 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-2c804ac7-e95c-41e0-98b8-e13ae2698485 req-59590f7b-784b-439f-8dc5-476b06762656 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031684 Jun 15 14:51:36.252016 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 490/1006] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:51:36.725481 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-388e6b73-104a-40c9-9dcf-f10d0a76451e tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:36.726159 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-388e6b73-104a-40c9-9dcf-f10d0a76451e tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 23c86dd2-372e-4d01-a22b-b311dcfe9811] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:36.733588 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-388e6b73-104a-40c9-9dcf-f10d0a76451e tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:36.734039 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-388e6b73-104a-40c9-9dcf-f10d0a76451e tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:36.734845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-388e6b73-104a-40c9-9dcf-f10d0a76451e tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:36.735490 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-388e6b73-104a-40c9-9dcf-f10d0a76451e tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:36.869689 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-388e6b73-104a-40c9-9dcf-f10d0a76451e tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:36.877325 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-388e6b73-104a-40c9-9dcf-f10d0a76451e tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811" status: 200 len: 1314 microversion: 2.1 time: 0.155679 Jun 15 14:51:36.877945 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 517/1007] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:36 2022] GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:37.896196 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-ba247f2e-9c78-4a96-b369-97985f7423f5 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:37.896927 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-ba247f2e-9c78-4a96-b369-97985f7423f5 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 23c86dd2-372e-4d01-a22b-b311dcfe9811] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:37.903245 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ba247f2e-9c78-4a96-b369-97985f7423f5 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:37.903692 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ba247f2e-9c78-4a96-b369-97985f7423f5 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:37.904464 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ba247f2e-9c78-4a96-b369-97985f7423f5 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:37.904907 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ba247f2e-9c78-4a96-b369-97985f7423f5 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:38.039412 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ba247f2e-9c78-4a96-b369-97985f7423f5 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:38.046866 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-ba247f2e-9c78-4a96-b369-97985f7423f5 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811" status: 200 len: 1314 microversion: 2.1 time: 0.156055 Jun 15 14:51:38.047428 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 491/1008] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:37 2022] GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:39.063996 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-baa3c97d-d4cf-4167-aae1-5b1afef93deb tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:39.064612 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-baa3c97d-d4cf-4167-aae1-5b1afef93deb tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 23c86dd2-372e-4d01-a22b-b311dcfe9811] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:39.071270 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-baa3c97d-d4cf-4167-aae1-5b1afef93deb tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:39.071718 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-baa3c97d-d4cf-4167-aae1-5b1afef93deb tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:39.072477 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-baa3c97d-d4cf-4167-aae1-5b1afef93deb tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:39.072911 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-baa3c97d-d4cf-4167-aae1-5b1afef93deb tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:39.203188 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-baa3c97d-d4cf-4167-aae1-5b1afef93deb tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:39.210581 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-baa3c97d-d4cf-4167-aae1-5b1afef93deb tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811" status: 200 len: 1314 microversion: 2.1 time: 0.150613 Jun 15 14:51:39.211154 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 518/1009] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:39 2022] GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:40.227811 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-de5f46b8-2c39-433a-8a33-46c5b4bee470 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:40.228448 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-de5f46b8-2c39-433a-8a33-46c5b4bee470 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 23c86dd2-372e-4d01-a22b-b311dcfe9811] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:40.235155 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-de5f46b8-2c39-433a-8a33-46c5b4bee470 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:40.235606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-de5f46b8-2c39-433a-8a33-46c5b4bee470 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:40.236378 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-de5f46b8-2c39-433a-8a33-46c5b4bee470 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:40.236815 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-de5f46b8-2c39-433a-8a33-46c5b4bee470 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:40.375980 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-de5f46b8-2c39-433a-8a33-46c5b4bee470 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:40.388244 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-de5f46b8-2c39-433a-8a33-46c5b4bee470 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811" status: 200 len: 1314 microversion: 2.1 time: 0.164444 Jun 15 14:51:40.389108 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 492/1010] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:40 2022] GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:41.378755 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-a0165431-7c5a-443c-96eb-4133556c2668 req-9c61d91e-be64-43fe-b3af-d6874464b206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c86dd2-372e-4d01-a22b-b311dcfe9811", "name": "network-vif-plugged", "status": "completed", "tag": "8f37e6a6-5dc0-476c-a48d-6f3171ac20f1"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:41.388231 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-a0165431-7c5a-443c-96eb-4133556c2668 req-9c61d91e-be64-43fe-b3af-d6874464b206 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:41.388673 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-a0165431-7c5a-443c-96eb-4133556c2668 req-9c61d91e-be64-43fe-b3af-d6874464b206 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:41.401352 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-a0165431-7c5a-443c-96eb-4133556c2668 req-9c61d91e-be64-43fe-b3af-d6874464b206 service nova] Creating event network-vif-plugged:8f37e6a6-5dc0-476c-a48d-6f3171ac20f1 for instance 23c86dd2-372e-4d01-a22b-b311dcfe9811 on hv-cinder-84327 Jun 15 14:51:41.406381 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-a0165431-7c5a-443c-96eb-4133556c2668 req-9c61d91e-be64-43fe-b3af-d6874464b206 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031478 Jun 15 14:51:41.407122 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 519/1011] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:51:41.410179 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c9fe3cf1-deea-43c8-8201-2ece769fb723 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:41.410792 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-c9fe3cf1-deea-43c8-8201-2ece769fb723 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 23c86dd2-372e-4d01-a22b-b311dcfe9811] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:41.418240 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c9fe3cf1-deea-43c8-8201-2ece769fb723 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:41.418691 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c9fe3cf1-deea-43c8-8201-2ece769fb723 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:41.419451 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c9fe3cf1-deea-43c8-8201-2ece769fb723 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:41.419882 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c9fe3cf1-deea-43c8-8201-2ece769fb723 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:41.552231 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-c9fe3cf1-deea-43c8-8201-2ece769fb723 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:41.560519 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-c9fe3cf1-deea-43c8-8201-2ece769fb723 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811" status: 200 len: 1314 microversion: 2.1 time: 0.153888 Jun 15 14:51:41.561135 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 493/1012] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:41 2022] GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:42.579424 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-7cd2fe44-d5e7-41fc-832b-9d909bad6221 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:42.580104 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-7cd2fe44-d5e7-41fc-832b-9d909bad6221 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 23c86dd2-372e-4d01-a22b-b311dcfe9811] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:42.586546 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7cd2fe44-d5e7-41fc-832b-9d909bad6221 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:42.586993 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7cd2fe44-d5e7-41fc-832b-9d909bad6221 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:42.587754 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7cd2fe44-d5e7-41fc-832b-9d909bad6221 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:42.588190 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7cd2fe44-d5e7-41fc-832b-9d909bad6221 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:42.721516 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-7cd2fe44-d5e7-41fc-832b-9d909bad6221 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:42.729822 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-7cd2fe44-d5e7-41fc-832b-9d909bad6221 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811" status: 200 len: 1314 microversion: 2.1 time: 0.155088 Jun 15 14:51:42.730390 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 520/1013] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:42 2022] GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:43.747122 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1cf93b39-7da9-42e4-b107-674ab126761e tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:43.747730 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1cf93b39-7da9-42e4-b107-674ab126761e tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 23c86dd2-372e-4d01-a22b-b311dcfe9811] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:43.750125 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=2 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:43.750802 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=6 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:43.758090 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1cf93b39-7da9-42e4-b107-674ab126761e tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:43.758538 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1cf93b39-7da9-42e4-b107-674ab126761e tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:43.759307 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1cf93b39-7da9-42e4-b107-674ab126761e tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:43.759740 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1cf93b39-7da9-42e4-b107-674ab126761e tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:43.890787 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-1cf93b39-7da9-42e4-b107-674ab126761e tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:43.898365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-1cf93b39-7da9-42e4-b107-674ab126761e tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811" status: 200 len: 1498 microversion: 2.1 time: 0.155108 Jun 15 14:51:43.898935 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 494/1014] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:43 2022] GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811 => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:44.518015 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f6fcb302-f238-4f2e-b031-fe0d1bc713f4 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:44.518553 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f6fcb302-f238-4f2e-b031-fe0d1bc713f4 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 23c86dd2-372e-4d01-a22b-b311dcfe9811] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:44.520599 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=2 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:44.527413 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f6fcb302-f238-4f2e-b031-fe0d1bc713f4 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:44.528205 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f6fcb302-f238-4f2e-b031-fe0d1bc713f4 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:44.528965 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f6fcb302-f238-4f2e-b031-fe0d1bc713f4 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:44.529397 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f6fcb302-f238-4f2e-b031-fe0d1bc713f4 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:44.555333 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f6fcb302-f238-4f2e-b031-fe0d1bc713f4 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 23c86dd2-372e-4d01-a22b-b311dcfe9811] Going to try to terminate instance {{(pid=124219) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:51:44.631361 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f6fcb302-f238-4f2e-b031-fe0d1bc713f4 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "DELETE /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811" status: 204 len: 0 microversion: 2.1 time: 0.116837 Jun 15 14:51:44.633031 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 521/1015] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:51:44 2022] DELETE /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:51:44.641382 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-ea45547b-05c8-4ce2-ad5e-a7273634ea0c tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:44.642042 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-ea45547b-05c8-4ce2-ad5e-a7273634ea0c tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 23c86dd2-372e-4d01-a22b-b311dcfe9811] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:44.649140 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ea45547b-05c8-4ce2-ad5e-a7273634ea0c tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:44.649589 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ea45547b-05c8-4ce2-ad5e-a7273634ea0c tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:44.650385 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ea45547b-05c8-4ce2-ad5e-a7273634ea0c tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:44.650820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ea45547b-05c8-4ce2-ad5e-a7273634ea0c tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:44.779338 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ea45547b-05c8-4ce2-ad5e-a7273634ea0c tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:44.786799 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-ea45547b-05c8-4ce2-ad5e-a7273634ea0c tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811" status: 200 len: 1504 microversion: 2.1 time: 0.149518 Jun 15 14:51:44.787382 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 495/1016] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:44 2022] GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:51:45.805819 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-156b0c7d-bd9a-48f4-96c0-cd6247282603 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:45.806541 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-156b0c7d-bd9a-48f4-96c0-cd6247282603 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 23c86dd2-372e-4d01-a22b-b311dcfe9811] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:45.813122 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-156b0c7d-bd9a-48f4-96c0-cd6247282603 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:45.813564 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-156b0c7d-bd9a-48f4-96c0-cd6247282603 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:45.814345 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-156b0c7d-bd9a-48f4-96c0-cd6247282603 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:45.814778 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-156b0c7d-bd9a-48f4-96c0-cd6247282603 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:45.942737 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-156b0c7d-bd9a-48f4-96c0-cd6247282603 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:45.950914 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-156b0c7d-bd9a-48f4-96c0-cd6247282603 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811" status: 200 len: 1504 microversion: 2.1 time: 0.150245 Jun 15 14:51:45.951479 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 522/1017] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:45 2022] GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:46.967865 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-dcb56952-90e3-46d3-8f63-5ab1c8a8e096 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:46.968476 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-dcb56952-90e3-46d3-8f63-5ab1c8a8e096 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 23c86dd2-372e-4d01-a22b-b311dcfe9811] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:46.975061 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-dcb56952-90e3-46d3-8f63-5ab1c8a8e096 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:46.976034 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-dcb56952-90e3-46d3-8f63-5ab1c8a8e096 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:46.976891 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-dcb56952-90e3-46d3-8f63-5ab1c8a8e096 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:46.977327 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-dcb56952-90e3-46d3-8f63-5ab1c8a8e096 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:47.198976 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-dcb56952-90e3-46d3-8f63-5ab1c8a8e096 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:47.206369 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-dcb56952-90e3-46d3-8f63-5ab1c8a8e096 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811" status: 200 len: 1504 microversion: 2.1 time: 0.242376 Jun 15 14:51:47.206928 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 496/1018] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:46 2022] GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811 => generated 1504 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:47.418240 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-24f30708-0a04-41ac-8164-5a518fe0fd43 req-72b6f051-35e5-4f22-bd1b-bf1fcc23516a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c86dd2-372e-4d01-a22b-b311dcfe9811", "name": "network-vif-deleted", "tag": "8f37e6a6-5dc0-476c-a48d-6f3171ac20f1"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:47.428009 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-24f30708-0a04-41ac-8164-5a518fe0fd43 req-72b6f051-35e5-4f22-bd1b-bf1fcc23516a service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:47.428537 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-24f30708-0a04-41ac-8164-5a518fe0fd43 req-72b6f051-35e5-4f22-bd1b-bf1fcc23516a service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:47.439797 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-24f30708-0a04-41ac-8164-5a518fe0fd43 req-72b6f051-35e5-4f22-bd1b-bf1fcc23516a service nova] Creating event network-vif-deleted:8f37e6a6-5dc0-476c-a48d-6f3171ac20f1 for instance 23c86dd2-372e-4d01-a22b-b311dcfe9811 on hv-cinder-84327 Jun 15 14:51:47.444597 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-24f30708-0a04-41ac-8164-5a518fe0fd43 req-72b6f051-35e5-4f22-bd1b-bf1fcc23516a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030003 Jun 15 14:51:47.445185 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 523/1019] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:51:48.224126 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-3147fad3-2038-47df-a93b-289f15de7f77 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:48.224654 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-3147fad3-2038-47df-a93b-289f15de7f77 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 23c86dd2-372e-4d01-a22b-b311dcfe9811] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:48.231557 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3147fad3-2038-47df-a93b-289f15de7f77 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:48.232014 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3147fad3-2038-47df-a93b-289f15de7f77 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:48.232774 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3147fad3-2038-47df-a93b-289f15de7f77 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:48.233246 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3147fad3-2038-47df-a93b-289f15de7f77 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:48.246885 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.wsgi [None req-3147fad3-2038-47df-a93b-289f15de7f77 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] HTTP exception thrown: Instance 23c86dd2-372e-4d01-a22b-b311dcfe9811 could not be found. Jun 15 14:51:48.248500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-3147fad3-2038-47df-a93b-289f15de7f77 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Request method failure captured: Jun 15 14:51:48.248500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: request: GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811 HTTP/1.1 Jun 15 14:51:48.248500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept: application/json Jun 15 14:51:48.248500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept-Encoding: identity Jun 15 14:51:48.248500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Connection: close Jun 15 14:51:48.248500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Length: 0 Jun 15 14:51:48.248500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Type: application/json Jun 15 14:51:48.248500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Host: 10.222.0.57 Jun 15 14:51:48.248500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Openstack-System-Scope: None Jun 15 14:51:48.248500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: User-Agent: python-urllib3/1.26.9 Jun 15 14:51:48.248500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Auth-Token: gAAAAABiqfHzX4pVY6jv15w46JmKJR5tXnJN8kSaau1dE0OzyjqrNisw9yVg1qJ1_fQIsEAgBr-c67D6MO2gD00HTObel4qCAWBYQEj6NQWGt9b0TkgVp9BqRUFWsAyN9QBUSQTgxky-8VU_41mSNva4pmZBO7cZHAg5dZAOe53xrrqqhdojwlU Jun 15 14:51:48.248500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Id: None Jun 15 14:51:48.248500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Name: None Jun 15 14:51:48.248500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Identity-Status: Confirmed Jun 15 14:51:48.248500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Is-Admin-Project: True Jun 15 14:51:48.248500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Id: default Jun 15 14:51:48.248500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Name: Default Jun 15 14:51:48.248500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Id: 8d40b771f30d4e668e0c908fbd0da517 Jun 15 14:51:48.248500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Name: tempest-VolumesActionsTest-812455990 Jun 15 14:51:48.248500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Role: member,reader Jun 15 14:51:48.248500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Roles: member,reader Jun 15 14:51:48.250072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8d40b771f30d4e668e0c908fbd0da517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8d40b771f30d4e668e0c908fbd0da517", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8d40b771f30d4e668e0c908fbd0da517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8d40b771f30d4e668e0c908fbd0da517"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:51:48.250072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant: tempest-VolumesActionsTest-812455990 Jun 15 14:51:48.250072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Id: 8d40b771f30d4e668e0c908fbd0da517 Jun 15 14:51:48.250072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Name: tempest-VolumesActionsTest-812455990 Jun 15 14:51:48.250072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User: tempest-VolumesActionsTest-812455990-project Jun 15 14:51:48.250072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Id: default Jun 15 14:51:48.250072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Name: Default Jun 15 14:51:48.250072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Id: 44f839b774b249dd9d7d3061feb2cd41 Jun 15 14:51:48.250072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Name: tempest-VolumesActionsTest-812455990-project Jun 15 14:51:48.250072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: method: > Jun 15 14:51:48.250072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: exception: Instance 23c86dd2-372e-4d01-a22b-b311dcfe9811 could not be found. Jun 15 14:51:48.250072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: action_args: {'id': '23c86dd2-372e-4d01-a22b-b311dcfe9811'} Jun 15 14:51:48.250972 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:51:48.250972 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:48.250972 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:51:48.250972 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:51:48.250972 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:51:48.250972 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:51:48.250972 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:51:48.250972 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:51:48.250972 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:51:48.250972 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:51:48.250972 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23c86dd2-372e-4d01-a22b-b311dcfe9811 could not be found. Jun 15 14:51:48.250972 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:48.250972 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:48.250972 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:48.250972 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:48.250972 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:48.250972 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:48.250972 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:51:48.250972 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:51:48.250972 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:51:48.252319 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:51:48.252319 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:51:48.252319 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:51:48.252319 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:51:48.252319 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:51:48.252319 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:51:48.252319 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:51:48.252319 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23c86dd2-372e-4d01-a22b-b311dcfe9811 could not be found. Jun 15 14:51:48.252319 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:48.252319 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:48.252319 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:48.252319 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:48.252319 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:48.252319 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:48.252319 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:51:48.252319 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:51:48.252319 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23c86dd2-372e-4d01-a22b-b311dcfe9811 could not be found. Jun 15 14:51:48.252319 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:51:48.253486 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-3147fad3-2038-47df-a93b-289f15de7f77 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Returning 404 to user: Instance 23c86dd2-372e-4d01-a22b-b311dcfe9811 could not be found. {{(pid=124220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:51:48.253486 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-3147fad3-2038-47df-a93b-289f15de7f77 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811" status: 404 len: 111 microversion: 2.1 time: 0.029708 Jun 15 14:51:48.253486 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 497/1020] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:48 2022] GET /compute/v2.1/servers/23c86dd2-372e-4d01-a22b-b311dcfe9811 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:51:48.298354 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f085612b-23ac-450e-ba57-51b22a1a0395 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1753765173", "imageRef": "e18802bf-9dac-462c-88ba-5cce79043279", "flavorRef": "452", "networks": [{"uuid": "0e570314-2b56-4138-8452-bfcbf1b594cc"}]}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:48.348779 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.network.neutron [None req-f085612b-23ac-450e-ba57-51b22a1a0395 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] validate_networks() for [('0e570314-2b56-4138-8452-bfcbf1b594cc', None, None, None, None, None)] {{(pid=124219) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:51:48.704149 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-f085612b-23ac-450e-ba57-51b22a1a0395 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Flavor limits 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:51:48.704719 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-f085612b-23ac-450e-ba57-51b22a1a0395 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Image limits 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:51:48.705169 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-f085612b-23ac-450e-ba57-51b22a1a0395 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Flavor pref 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:51:48.705587 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-f085612b-23ac-450e-ba57-51b22a1a0395 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Image pref 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:51:48.706069 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-f085612b-23ac-450e-ba57-51b22a1a0395 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:51:48.716065 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f085612b-23ac-450e-ba57-51b22a1a0395 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:48.716516 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f085612b-23ac-450e-ba57-51b22a1a0395 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:48.717323 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f085612b-23ac-450e-ba57-51b22a1a0395 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:48.717795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f085612b-23ac-450e-ba57-51b22a1a0395 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:48.735579 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-f085612b-23ac-450e-ba57-51b22a1a0395 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Getting quotas for project 8d40b771f30d4e668e0c908fbd0da517. Resources: {'cores', 'instances', 'ram'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:51:48.739595 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-f085612b-23ac-450e-ba57-51b22a1a0395 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Getting quotas for user 44f839b774b249dd9d7d3061feb2cd41 and project 8d40b771f30d4e668e0c908fbd0da517. Resources: {'cores', 'instances', 'ram'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:51:48.750263 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f085612b-23ac-450e-ba57-51b22a1a0395 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Going to run 1 instances... {{(pid=124219) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:51:48.752603 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f085612b-23ac-450e-ba57-51b22a1a0395 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 9c33de4c-57f5-4861-b235-9f1028907dbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e18802bf-9dac-462c-88ba-5cce79043279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124219) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:51:48.798492 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f085612b-23ac-450e-ba57-51b22a1a0395 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504228 Jun 15 14:51:48.799134 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 524/1021] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 14:51:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:51:48.809145 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-d0ae3187-22bf-45df-bc72-6d4225ca608a tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:48.809903 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-d0ae3187-22bf-45df-bc72-6d4225ca608a tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 9c33de4c-57f5-4861-b235-9f1028907dbd] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:48.863070 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-d0ae3187-22bf-45df-bc72-6d4225ca608a tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:48.869972 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-d0ae3187-22bf-45df-bc72-6d4225ca608a tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd" status: 200 len: 1214 microversion: 2.1 time: 0.064735 Jun 15 14:51:48.870534 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 498/1022] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:48 2022] GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:51:49.887655 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e3a83323-4b25-4d71-a7f7-cfd2cf1c2481 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:49.888922 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-e3a83323-4b25-4d71-a7f7-cfd2cf1c2481 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 9c33de4c-57f5-4861-b235-9f1028907dbd] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:49.896639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e3a83323-4b25-4d71-a7f7-cfd2cf1c2481 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:49.897085 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e3a83323-4b25-4d71-a7f7-cfd2cf1c2481 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:49.898252 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e3a83323-4b25-4d71-a7f7-cfd2cf1c2481 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:49.898694 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e3a83323-4b25-4d71-a7f7-cfd2cf1c2481 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:49.972478 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e3a83323-4b25-4d71-a7f7-cfd2cf1c2481 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:49.981561 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-e3a83323-4b25-4d71-a7f7-cfd2cf1c2481 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd" status: 200 len: 1274 microversion: 2.1 time: 0.098403 Jun 15 14:51:49.982355 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 525/1023] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:49 2022] GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd => generated 1274 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:50.172551 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-fcd921bb-4599-49a6-a9d5-a1baf7032b42 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:50.173531 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-fcd921bb-4599-49a6-a9d5-a1baf7032b42 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:50.183112 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fcd921bb-4599-49a6-a9d5-a1baf7032b42 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:50.183573 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fcd921bb-4599-49a6-a9d5-a1baf7032b42 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:50.184343 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fcd921bb-4599-49a6-a9d5-a1baf7032b42 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:50.184782 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fcd921bb-4599-49a6-a9d5-a1baf7032b42 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:50.214008 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-fcd921bb-4599-49a6-a9d5-a1baf7032b42 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045361 Jun 15 14:51:50.214566 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 499/1024] 10.222.0.57 () {60 vars in 1342 bytes} [Wed Jun 15 14:51:50 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:50.274307 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-42d61f56-bad8-4362-aef2-9d356a1864fc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:50.274815 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-42d61f56-bad8-4362-aef2-9d356a1864fc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:50.280876 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-42d61f56-bad8-4362-aef2-9d356a1864fc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:50.281361 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-42d61f56-bad8-4362-aef2-9d356a1864fc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:50.282170 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-42d61f56-bad8-4362-aef2-9d356a1864fc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:50.282617 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-42d61f56-bad8-4362-aef2-9d356a1864fc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:50.312258 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-42d61f56-bad8-4362-aef2-9d356a1864fc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Going to try to terminate instance {{(pid=124219) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:51:50.392667 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-42d61f56-bad8-4362-aef2-9d356a1864fc tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 204 len: 0 microversion: 2.20 time: 0.122364 Jun 15 14:51:50.393197 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 526/1025] 10.222.0.57 () {60 vars in 1279 bytes} [Wed Jun 15 14:51:50 2022] DELETE /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 14:51:50.403022 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-ee800086-6c4d-415c-9d89-9d8241993956 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:50.403736 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-ee800086-6c4d-415c-9d89-9d8241993956 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:50.409830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ee800086-6c4d-415c-9d89-9d8241993956 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:50.410351 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ee800086-6c4d-415c-9d89-9d8241993956 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:50.411187 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ee800086-6c4d-415c-9d89-9d8241993956 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:50.411715 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ee800086-6c4d-415c-9d89-9d8241993956 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:50.595112 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ee800086-6c4d-415c-9d89-9d8241993956 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:50.604431 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ee800086-6c4d-415c-9d89-9d8241993956 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:50.606734 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ee800086-6c4d-415c-9d89-9d8241993956 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:50.608308 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-ee800086-6c4d-415c-9d89-9d8241993956 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1720 microversion: 2.20 time: 0.209332 Jun 15 14:51:50.609947 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 500/1026] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:50 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1720 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:51:50.999502 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-9e45cee4-5423-4d3b-a74a-b3c0a5a2eefc tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:51.000110 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-9e45cee4-5423-4d3b-a74a-b3c0a5a2eefc tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 9c33de4c-57f5-4861-b235-9f1028907dbd] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:51.006749 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9e45cee4-5423-4d3b-a74a-b3c0a5a2eefc tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:51.007702 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9e45cee4-5423-4d3b-a74a-b3c0a5a2eefc tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:51.008651 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9e45cee4-5423-4d3b-a74a-b3c0a5a2eefc tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:51.009091 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9e45cee4-5423-4d3b-a74a-b3c0a5a2eefc tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:51.138490 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-9e45cee4-5423-4d3b-a74a-b3c0a5a2eefc tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:51.145946 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-9e45cee4-5423-4d3b-a74a-b3c0a5a2eefc tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd" status: 200 len: 1314 microversion: 2.1 time: 0.150828 Jun 15 14:51:51.146508 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 527/1027] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:50 2022] GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:51.437828 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-398fc056-edbf-404b-9b56-11c3c40cbf0c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:51.438387 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-398fc056-edbf-404b-9b56-11c3c40cbf0c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:51.445880 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-398fc056-edbf-404b-9b56-11c3c40cbf0c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:51.446369 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-398fc056-edbf-404b-9b56-11c3c40cbf0c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:51.447172 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-398fc056-edbf-404b-9b56-11c3c40cbf0c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:51.447608 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-398fc056-edbf-404b-9b56-11c3c40cbf0c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:51.471440 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-398fc056-edbf-404b-9b56-11c3c40cbf0c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff/ips" status: 200 len: 150 microversion: 2.1 time: 0.037510 Jun 15 14:51:51.471993 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 501/1028] 10.222.0.57 () {58 vars in 1247 bytes} [Wed Jun 15 14:51:51 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:51:51.629123 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-32968e54-f4aa-4c37-9147-564e76736db6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:51.629903 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-32968e54-f4aa-4c37-9147-564e76736db6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:51.636573 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-32968e54-f4aa-4c37-9147-564e76736db6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:51.637026 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-32968e54-f4aa-4c37-9147-564e76736db6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:51.637833 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-32968e54-f4aa-4c37-9147-564e76736db6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:51.638275 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-32968e54-f4aa-4c37-9147-564e76736db6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:51.799840 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-32968e54-f4aa-4c37-9147-564e76736db6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:51.809805 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-32968e54-f4aa-4c37-9147-564e76736db6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:51.811329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-32968e54-f4aa-4c37-9147-564e76736db6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:51.812475 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-32968e54-f4aa-4c37-9147-564e76736db6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1720 microversion: 2.20 time: 0.187950 Jun 15 14:51:51.813023 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 528/1029] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:51 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1720 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:52.163516 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-192226cd-8d52-4c91-9ebe-eee77acfd4be tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:52.164172 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-192226cd-8d52-4c91-9ebe-eee77acfd4be tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 9c33de4c-57f5-4861-b235-9f1028907dbd] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:52.170631 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-192226cd-8d52-4c91-9ebe-eee77acfd4be tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:52.171148 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-192226cd-8d52-4c91-9ebe-eee77acfd4be tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:52.171979 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-192226cd-8d52-4c91-9ebe-eee77acfd4be tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:52.172472 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-192226cd-8d52-4c91-9ebe-eee77acfd4be tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:52.378126 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-192226cd-8d52-4c91-9ebe-eee77acfd4be tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:52.386372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-192226cd-8d52-4c91-9ebe-eee77acfd4be tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd" status: 200 len: 1314 microversion: 2.1 time: 0.227429 Jun 15 14:51:52.386953 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 502/1030] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:52 2022] GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:52.848451 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f3150716-0ba1-42f2-90ae-57f9a4c758a4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:52.849462 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-b89029bd-4e7c-4997-a643-eca9b2d228ad tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5aab045c-5fdd-4b4a-8ac9-8e44a6531ac7"}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:52.852858 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f3150716-0ba1-42f2-90ae-57f9a4c758a4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:52.854155 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-b89029bd-4e7c-4997-a643-eca9b2d228ad tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:52.872690 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b89029bd-4e7c-4997-a643-eca9b2d228ad tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:52.873139 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b89029bd-4e7c-4997-a643-eca9b2d228ad tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:52.873932 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b89029bd-4e7c-4997-a643-eca9b2d228ad tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:52.875832 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f3150716-0ba1-42f2-90ae-57f9a4c758a4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:52.876415 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b89029bd-4e7c-4997-a643-eca9b2d228ad tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:52.876533 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f3150716-0ba1-42f2-90ae-57f9a4c758a4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:52.877531 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f3150716-0ba1-42f2-90ae-57f9a4c758a4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:52.877998 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f3150716-0ba1-42f2-90ae-57f9a4c758a4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:53.101553 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f3150716-0ba1-42f2-90ae-57f9a4c758a4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:53.117780 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f3150716-0ba1-42f2-90ae-57f9a4c758a4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:53.119324 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f3150716-0ba1-42f2-90ae-57f9a4c758a4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:53.120516 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f3150716-0ba1-42f2-90ae-57f9a4c758a4 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1720 microversion: 2.20 time: 0.292353 Jun 15 14:51:53.133037 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 529/1031] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:52 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1720 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:53.139767 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-1b4dc78a-0610-4b01-8884-f9de72d669f2 req-d5c577b4-3824-4378-99cb-33f9dcae208c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c33de4c-57f5-4861-b235-9f1028907dbd", "tag": "32920329-8983-4739-8d2a-dd1279e15085"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:53.148785 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-1b4dc78a-0610-4b01-8884-f9de72d669f2 req-d5c577b4-3824-4378-99cb-33f9dcae208c service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:53.149239 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-1b4dc78a-0610-4b01-8884-f9de72d669f2 req-d5c577b4-3824-4378-99cb-33f9dcae208c service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:53.160537 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-1b4dc78a-0610-4b01-8884-f9de72d669f2 req-d5c577b4-3824-4378-99cb-33f9dcae208c service nova] Creating event network-changed:32920329-8983-4739-8d2a-dd1279e15085 for instance 9c33de4c-57f5-4861-b235-9f1028907dbd on hv-cinder-84327 Jun 15 14:51:53.166440 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-1b4dc78a-0610-4b01-8884-f9de72d669f2 req-d5c577b4-3824-4378-99cb-33f9dcae208c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032003 Jun 15 14:51:53.167401 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 530/1032] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:51:53.228331 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-b89029bd-4e7c-4997-a643-eca9b2d228ad tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "POST /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.383940 Jun 15 14:51:53.229232 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 503/1033] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 14:51:52 2022] POST /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff/os-volume_attachments => generated 194 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:51:53.405644 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-94c11939-83a3-480e-8aa4-ef6a07564c2f tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:53.406834 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-94c11939-83a3-480e-8aa4-ef6a07564c2f tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 9c33de4c-57f5-4861-b235-9f1028907dbd] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:53.416618 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-94c11939-83a3-480e-8aa4-ef6a07564c2f tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:53.417078 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-94c11939-83a3-480e-8aa4-ef6a07564c2f tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:53.417890 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-94c11939-83a3-480e-8aa4-ef6a07564c2f tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:53.418523 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-94c11939-83a3-480e-8aa4-ef6a07564c2f tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:53.705995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-94c11939-83a3-480e-8aa4-ef6a07564c2f tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:53.709381 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:53.717158 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-94c11939-83a3-480e-8aa4-ef6a07564c2f tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd" status: 200 len: 1314 microversion: 2.1 time: 0.316090 Jun 15 14:51:53.727366 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 531/1034] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:53 2022] GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:53.903005 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-543690db-7a9e-43ca-9b38-f962f2ad8cee req-63950d98-5077-4e8e-8547-06a78ff5f1ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d0cbdc8-d87b-4ce4-97d1-59aca342287a", "name": "network-vif-deleted", "tag": "bf1963f9-4d7c-4562-9c53-6c53a728e8c6"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:53.912194 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-543690db-7a9e-43ca-9b38-f962f2ad8cee req-63950d98-5077-4e8e-8547-06a78ff5f1ce service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:53.912642 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-543690db-7a9e-43ca-9b38-f962f2ad8cee req-63950d98-5077-4e8e-8547-06a78ff5f1ce service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:53.924563 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-543690db-7a9e-43ca-9b38-f962f2ad8cee req-63950d98-5077-4e8e-8547-06a78ff5f1ce service nova] Creating event network-vif-deleted:bf1963f9-4d7c-4562-9c53-6c53a728e8c6 for instance 7d0cbdc8-d87b-4ce4-97d1-59aca342287a on hv-cinder-84327 Jun 15 14:51:53.930078 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-543690db-7a9e-43ca-9b38-f962f2ad8cee req-63950d98-5077-4e8e-8547-06a78ff5f1ce service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031542 Jun 15 14:51:53.930711 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 504/1035] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:51:54.140676 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-8bbf4621-5488-4418-9e7b-a6dbbb47ecf3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:54.141341 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-8bbf4621-5488-4418-9e7b-a6dbbb47ecf3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:54.148791 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8bbf4621-5488-4418-9e7b-a6dbbb47ecf3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:54.149246 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8bbf4621-5488-4418-9e7b-a6dbbb47ecf3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:54.150041 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8bbf4621-5488-4418-9e7b-a6dbbb47ecf3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:54.150479 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8bbf4621-5488-4418-9e7b-a6dbbb47ecf3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:54.216773 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-8bbf4621-5488-4418-9e7b-a6dbbb47ecf3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:54.225261 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-8bbf4621-5488-4418-9e7b-a6dbbb47ecf3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:54.227480 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-8bbf4621-5488-4418-9e7b-a6dbbb47ecf3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:54.228949 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-8bbf4621-5488-4418-9e7b-a6dbbb47ecf3 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1655 microversion: 2.20 time: 0.093353 Jun 15 14:51:54.229737 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 532/1036] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:54 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1655 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:54.735719 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-9cf50fc6-6c83-4679-8e75-04595147331d tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:54.736436 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-9cf50fc6-6c83-4679-8e75-04595147331d tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 9c33de4c-57f5-4861-b235-9f1028907dbd] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:54.744044 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9cf50fc6-6c83-4679-8e75-04595147331d tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:54.744627 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9cf50fc6-6c83-4679-8e75-04595147331d tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:54.745435 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9cf50fc6-6c83-4679-8e75-04595147331d tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:54.745912 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9cf50fc6-6c83-4679-8e75-04595147331d tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:54.878742 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-9cf50fc6-6c83-4679-8e75-04595147331d tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:54.886611 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-9cf50fc6-6c83-4679-8e75-04595147331d tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd" status: 200 len: 1314 microversion: 2.1 time: 0.155439 Jun 15 14:51:54.887040 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 505/1037] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:54 2022] GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:55.248154 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-05aff907-ed73-46c2-95d8-bc831e385bff tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:55.248759 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-05aff907-ed73-46c2-95d8-bc831e385bff tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:55.255383 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-05aff907-ed73-46c2-95d8-bc831e385bff tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:55.255828 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-05aff907-ed73-46c2-95d8-bc831e385bff tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:55.257194 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-05aff907-ed73-46c2-95d8-bc831e385bff tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:55.258069 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-05aff907-ed73-46c2-95d8-bc831e385bff tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:55.293295 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-05aff907-ed73-46c2-95d8-bc831e385bff tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:55.293785 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-05aff907-ed73-46c2-95d8-bc831e385bff tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:55.294241 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.objects.instance [None req-05aff907-ed73-46c2-95d8-bc831e385bff tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lazy-loading 'fault' on Instance uuid 7d0cbdc8-d87b-4ce4-97d1-59aca342287a {{(pid=124219) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:51:55.363006 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-05aff907-ed73-46c2-95d8-bc831e385bff tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:55.372361 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-05aff907-ed73-46c2-95d8-bc831e385bff tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:55.374029 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-05aff907-ed73-46c2-95d8-bc831e385bff tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d58ac7f49454fd6a5b5eef6a1e8b2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1cdbd5dc9471f9f1732600ab98c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:55.375198 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-05aff907-ed73-46c2-95d8-bc831e385bff tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 200 len: 1371 microversion: 2.20 time: 0.131102 Jun 15 14:51:55.375758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 533/1038] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:55 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 1371 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:51:55.903222 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-dcc0af7d-1934-4487-bf62-6a277cc8f21c tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:55.903837 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-dcc0af7d-1934-4487-bf62-6a277cc8f21c tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 9c33de4c-57f5-4861-b235-9f1028907dbd] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:55.910285 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-dcc0af7d-1934-4487-bf62-6a277cc8f21c tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:55.910728 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-dcc0af7d-1934-4487-bf62-6a277cc8f21c tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:55.911514 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-dcc0af7d-1934-4487-bf62-6a277cc8f21c tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:55.912656 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-dcc0af7d-1934-4487-bf62-6a277cc8f21c tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:56.046106 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-dcc0af7d-1934-4487-bf62-6a277cc8f21c tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:56.054176 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-dcc0af7d-1934-4487-bf62-6a277cc8f21c tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd" status: 200 len: 1314 microversion: 2.1 time: 0.154326 Jun 15 14:51:56.054735 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 506/1039] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:55 2022] GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:56.393913 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-53453528-7cca-4db5-84d5-c4c06e13c038 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:56.394450 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-53453528-7cca-4db5-84d5-c4c06e13c038 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:56.401511 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-53453528-7cca-4db5-84d5-c4c06e13c038 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:56.402008 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-53453528-7cca-4db5-84d5-c4c06e13c038 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:56.402773 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-53453528-7cca-4db5-84d5-c4c06e13c038 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:56.403213 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-53453528-7cca-4db5-84d5-c4c06e13c038 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:56.417627 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-53453528-7cca-4db5-84d5-c4c06e13c038 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] HTTP exception thrown: Instance 7d0cbdc8-d87b-4ce4-97d1-59aca342287a could not be found. Jun 15 14:51:56.419163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-53453528-7cca-4db5-84d5-c4c06e13c038 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Request method failure captured: Jun 15 14:51:56.419163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a HTTP/1.1 Jun 15 14:51:56.419163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:51:56.419163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:51:56.419163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:51:56.419163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:51:56.419163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:51:56.419163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:51:56.419163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:51:56.419163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:51:56.419163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfAA0mnjUk175IWqfAnuySq8diJuJh9uxnkwWapaH-5-FMWzBuA5NVj9WboUQ-ufMSuLPkzWCRQ0mIiojDDYwthrSu-gA9a-X4dPJrTHNRu1qaTcVuKHRzG1UZWR1d5E5u7spbhsaL-BHv6MvelnUqazpvOiB3dPVF-4UFF45gZJBYk Jun 15 14:51:56.419163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:51:56.419163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:51:56.419163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:51:56.419163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:51:56.419163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 14:51:56.419163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:51:56.419163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:51:56.419163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 4bf1cdbd5dc9471f9f1732600ab98c24 Jun 15 14:51:56.419163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1247917787 Jun 15 14:51:56.419163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:51:56.419163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:51:56.420842 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4bf1cdbd5dc9471f9f1732600ab98c24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4bf1cdbd5dc9471f9f1732600ab98c24", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4bf1cdbd5dc9471f9f1732600ab98c24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4bf1cdbd5dc9471f9f1732600ab98c24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:51:56.420842 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1247917787 Jun 15 14:51:56.420842 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 4bf1cdbd5dc9471f9f1732600ab98c24 Jun 15 14:51:56.420842 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1247917787 Jun 15 14:51:56.420842 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-AttachVolumeShelveTestJSON-1247917787-project Jun 15 14:51:56.420842 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:51:56.420842 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:51:56.420842 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 1d58ac7f49454fd6a5b5eef6a1e8b2d8 Jun 15 14:51:56.420842 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1247917787-project Jun 15 14:51:56.420842 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:51:56.420842 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Instance 7d0cbdc8-d87b-4ce4-97d1-59aca342287a could not be found. Jun 15 14:51:56.420842 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': '7d0cbdc8-d87b-4ce4-97d1-59aca342287a'} Jun 15 14:51:56.421684 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:51:56.421684 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:56.421684 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:51:56.421684 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:51:56.421684 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:51:56.421684 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:51:56.421684 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:51:56.421684 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:51:56.421684 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:51:56.421684 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:51:56.421684 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d0cbdc8-d87b-4ce4-97d1-59aca342287a could not be found. Jun 15 14:51:56.421684 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:56.421684 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:56.421684 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:56.421684 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:56.421684 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:56.421684 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:56.421684 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:51:56.421684 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:51:56.421684 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:51:56.423202 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:51:56.423202 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:51:56.423202 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:51:56.423202 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:51:56.423202 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:51:56.423202 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:51:56.423202 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:51:56.423202 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d0cbdc8-d87b-4ce4-97d1-59aca342287a could not be found. Jun 15 14:51:56.423202 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:56.423202 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:56.423202 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:56.423202 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:56.423202 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:56.423202 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:56.423202 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:51:56.423202 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:51:56.423202 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d0cbdc8-d87b-4ce4-97d1-59aca342287a could not be found. Jun 15 14:51:56.423202 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:56.424527 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-53453528-7cca-4db5-84d5-c4c06e13c038 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Returning 404 to user: Instance 7d0cbdc8-d87b-4ce4-97d1-59aca342287a could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:51:56.424527 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-53453528-7cca-4db5-84d5-c4c06e13c038 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 404 len: 111 microversion: 2.20 time: 0.030704 Jun 15 14:51:56.424527 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 534/1040] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:56 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 14:51:56.429542 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-bc8eec58-d9a5-4e3e-9d26-10fc24710737 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '.version_select at 0x7f8f136ab700>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:56.455099 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-bc8eec58-d9a5-4e3e-9d26-10fc24710737 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240190059" status: 204 len: 0 microversion: 2.20 time: 0.029329 Jun 15 14:51:56.459621 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 507/1041] 10.222.0.57 () {60 vars in 1261 bytes} [Wed Jun 15 14:51:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240190059 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 14:51:56.526726 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-bb184bf7-aecd-4e96-a846-3495fc1c01f3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Action: 'create', calling method: .version_select at 0x7f8f13d45820>, body: {"keypair": {"name": "tempest-keypair-1331277290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJFrkTRunY6g4csGubn7deNP45kO3qZWtvHmEd0aIXkFiC2/0scfhATCDt4YAg3owujzmmHneHfhJOc4B4wuzts3pZOWxSURbM8z9INISJVkm+Eeon8Wfqp9YItCINmOw=="}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:56.541134 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-bb184bf7-aecd-4e96-a846-3495fc1c01f3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Getting quotas for project 591d111357224477998b265d45e3ee0d. Resources: {'key_pairs'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:51:56.544996 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-bb184bf7-aecd-4e96-a846-3495fc1c01f3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Getting quotas for user 6caa64aecb914e968d057b6b593f667f and project 591d111357224477998b265d45e3ee0d. Resources: {'key_pairs'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:51:56.568712 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-bb184bf7-aecd-4e96-a846-3495fc1c01f3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046271 Jun 15 14:51:56.569882 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 535/1042] 10.222.0.57 () {60 vars in 1158 bytes} [Wed Jun 15 14:51:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:51:57.072022 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1360be8b-e76a-4c23-aea5-d956a60d0920 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:57.072674 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1360be8b-e76a-4c23-aea5-d956a60d0920 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 9c33de4c-57f5-4861-b235-9f1028907dbd] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:57.081180 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1360be8b-e76a-4c23-aea5-d956a60d0920 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:57.081630 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1360be8b-e76a-4c23-aea5-d956a60d0920 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:57.082427 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1360be8b-e76a-4c23-aea5-d956a60d0920 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:57.082859 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1360be8b-e76a-4c23-aea5-d956a60d0920 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:57.088177 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:57.292749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-1360be8b-e76a-4c23-aea5-d956a60d0920 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:57.302216 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-1360be8b-e76a-4c23-aea5-d956a60d0920 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd" status: 200 len: 1314 microversion: 2.1 time: 0.235291 Jun 15 14:51:57.303664 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 508/1043] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:57 2022] GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:57.468863 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-5779ea9a-0beb-4c58-aa07-38d884751690 req-fef47145-9aa3-45f2-b7df-11e7d862d0bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c33de4c-57f5-4861-b235-9f1028907dbd", "name": "network-vif-plugged", "status": "completed", "tag": "32920329-8983-4739-8d2a-dd1279e15085"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:57.501610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-5779ea9a-0beb-4c58-aa07-38d884751690 req-fef47145-9aa3-45f2-b7df-11e7d862d0bb service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:57.501829 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-5779ea9a-0beb-4c58-aa07-38d884751690 req-fef47145-9aa3-45f2-b7df-11e7d862d0bb service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:57.517130 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-5779ea9a-0beb-4c58-aa07-38d884751690 req-fef47145-9aa3-45f2-b7df-11e7d862d0bb service nova] Creating event network-vif-plugged:32920329-8983-4739-8d2a-dd1279e15085 for instance 9c33de4c-57f5-4861-b235-9f1028907dbd on hv-cinder-84327 Jun 15 14:51:57.527745 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-5779ea9a-0beb-4c58-aa07-38d884751690 req-fef47145-9aa3-45f2-b7df-11e7d862d0bb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066059 Jun 15 14:51:57.529792 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 536/1044] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:51:58.227577 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-ace9a61a-8280-48d9-ad8c-853b0c8d7e24 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1367344604", "imageRef": "e18802bf-9dac-462c-88ba-5cce79043279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ffec14f9-f069-4e9d-93e1-f0addcf3eda2"}], "security_groups": [{"name": "tempest-securitygroup--1957858090"}], "key_name": "tempest-keypair-1331277290", "user_data": "}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:58.320576 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-ca028804-256c-436e-befd-d5ba05778030 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:58.321368 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-ca028804-256c-436e-befd-d5ba05778030 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 9c33de4c-57f5-4861-b235-9f1028907dbd] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:58.328208 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ca028804-256c-436e-befd-d5ba05778030 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:58.329465 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ca028804-256c-436e-befd-d5ba05778030 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:58.330056 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.network.neutron [None req-ace9a61a-8280-48d9-ad8c-853b0c8d7e24 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] validate_networks() for [('ffec14f9-f069-4e9d-93e1-f0addcf3eda2', None, None, None, None, None)] {{(pid=124220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:51:58.330475 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ca028804-256c-436e-befd-d5ba05778030 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:58.330940 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ca028804-256c-436e-befd-d5ba05778030 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:58.471005 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-ca028804-256c-436e-befd-d5ba05778030 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:58.480013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-ca028804-256c-436e-befd-d5ba05778030 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd" status: 200 len: 1314 microversion: 2.1 time: 0.163635 Jun 15 14:51:58.480583 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 537/1045] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:58 2022] GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:51:58.665518 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0da53629-87c0-47eb-84c8-153751a76b1a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:58.666045 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-0da53629-87c0-47eb-84c8-153751a76b1a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:58.672537 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0da53629-87c0-47eb-84c8-153751a76b1a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:58.672992 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0da53629-87c0-47eb-84c8-153751a76b1a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:58.673783 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0da53629-87c0-47eb-84c8-153751a76b1a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:58.674225 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0da53629-87c0-47eb-84c8-153751a76b1a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:58.687577 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-0da53629-87c0-47eb-84c8-153751a76b1a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] HTTP exception thrown: Instance 7d0cbdc8-d87b-4ce4-97d1-59aca342287a could not be found. Jun 15 14:51:58.689274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0da53629-87c0-47eb-84c8-153751a76b1a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Request method failure captured: Jun 15 14:51:58.689274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: DELETE /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a HTTP/1.1 Jun 15 14:51:58.689274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:51:58.689274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:51:58.689274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:51:58.689274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:51:58.689274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:51:58.689274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:51:58.689274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:51:58.689274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:51:58.689274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfAA0mnjUk175IWqfAnuySq8diJuJh9uxnkwWapaH-5-FMWzBuA5NVj9WboUQ-ufMSuLPkzWCRQ0mIiojDDYwthrSu-gA9a-X4dPJrTHNRu1qaTcVuKHRzG1UZWR1d5E5u7spbhsaL-BHv6MvelnUqazpvOiB3dPVF-4UFF45gZJBYk Jun 15 14:51:58.689274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:51:58.689274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:51:58.689274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:51:58.689274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:51:58.689274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 14:51:58.689274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:51:58.689274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:51:58.689274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 4bf1cdbd5dc9471f9f1732600ab98c24 Jun 15 14:51:58.689274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1247917787 Jun 15 14:51:58.689274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:51:58.689274 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:51:58.691010 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4bf1cdbd5dc9471f9f1732600ab98c24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4bf1cdbd5dc9471f9f1732600ab98c24", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4bf1cdbd5dc9471f9f1732600ab98c24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4bf1cdbd5dc9471f9f1732600ab98c24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:51:58.691010 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1247917787 Jun 15 14:51:58.691010 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 4bf1cdbd5dc9471f9f1732600ab98c24 Jun 15 14:51:58.691010 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1247917787 Jun 15 14:51:58.691010 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-AttachVolumeShelveTestJSON-1247917787-project Jun 15 14:51:58.691010 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:51:58.691010 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:51:58.691010 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 1d58ac7f49454fd6a5b5eef6a1e8b2d8 Jun 15 14:51:58.691010 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1247917787-project Jun 15 14:51:58.691010 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:51:58.691010 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Instance 7d0cbdc8-d87b-4ce4-97d1-59aca342287a could not be found. Jun 15 14:51:58.691010 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': '7d0cbdc8-d87b-4ce4-97d1-59aca342287a'} Jun 15 14:51:58.691934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:51:58.691934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:58.691934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:51:58.691934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:51:58.691934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:51:58.691934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:51:58.691934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:51:58.691934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:51:58.691934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:51:58.691934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:51:58.691934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d0cbdc8-d87b-4ce4-97d1-59aca342287a could not be found. Jun 15 14:51:58.691934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:58.691934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:58.691934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:58.691934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:58.691934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:58.691934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:58.691934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:51:58.691934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:51:58.691934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:51:58.693382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:51:58.693382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 14:51:58.693382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 14:51:58.693382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 14:51:58.693382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 14:51:58.693382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:51:58.693382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:51:58.693382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:51:58.693382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:51:58.693382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d0cbdc8-d87b-4ce4-97d1-59aca342287a could not be found. Jun 15 14:51:58.693382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:58.693382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:58.693382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:58.693382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:58.693382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:58.693382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:58.693382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:51:58.693382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:51:58.693382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d0cbdc8-d87b-4ce4-97d1-59aca342287a could not be found. Jun 15 14:51:58.693382 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:58.695704 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0da53629-87c0-47eb-84c8-153751a76b1a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Returning 404 to user: Instance 7d0cbdc8-d87b-4ce4-97d1-59aca342287a could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:51:58.695704 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-0da53629-87c0-47eb-84c8-153751a76b1a tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 404 len: 111 microversion: 2.20 time: 0.029899 Jun 15 14:51:58.695704 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 538/1046] 10.222.0.57 () {60 vars in 1279 bytes} [Wed Jun 15 14:51:58 2022] DELETE /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 15 14:51:58.699132 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-72e3adf0-45d7-4775-92e8-891cf591aba6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:58.699724 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-72e3adf0-45d7-4775-92e8-891cf591aba6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 7d0cbdc8-d87b-4ce4-97d1-59aca342287a] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:58.705548 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-72e3adf0-45d7-4775-92e8-891cf591aba6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:58.706032 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-72e3adf0-45d7-4775-92e8-891cf591aba6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:58.706798 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-72e3adf0-45d7-4775-92e8-891cf591aba6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:58.707236 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-72e3adf0-45d7-4775-92e8-891cf591aba6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:58.707869 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-ace9a61a-8280-48d9-ad8c-853b0c8d7e24 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Flavor limits 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:51:58.708336 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-ace9a61a-8280-48d9-ad8c-853b0c8d7e24 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Image limits 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:51:58.708814 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-ace9a61a-8280-48d9-ad8c-853b0c8d7e24 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Flavor pref 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:51:58.709229 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-ace9a61a-8280-48d9-ad8c-853b0c8d7e24 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Image pref 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:51:58.710403 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-ace9a61a-8280-48d9-ad8c-853b0c8d7e24 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:51:58.719528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ace9a61a-8280-48d9-ad8c-853b0c8d7e24 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:58.719973 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ace9a61a-8280-48d9-ad8c-853b0c8d7e24 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:58.720773 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ace9a61a-8280-48d9-ad8c-853b0c8d7e24 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:58.721206 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ace9a61a-8280-48d9-ad8c-853b0c8d7e24 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:58.721552 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-72e3adf0-45d7-4775-92e8-891cf591aba6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] HTTP exception thrown: Instance 7d0cbdc8-d87b-4ce4-97d1-59aca342287a could not be found. Jun 15 14:51:58.723250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-72e3adf0-45d7-4775-92e8-891cf591aba6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Request method failure captured: Jun 15 14:51:58.723250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a HTTP/1.1 Jun 15 14:51:58.723250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:51:58.723250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:51:58.723250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:51:58.723250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:51:58.723250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:51:58.723250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:51:58.723250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:51:58.723250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:51:58.723250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfAA0mnjUk175IWqfAnuySq8diJuJh9uxnkwWapaH-5-FMWzBuA5NVj9WboUQ-ufMSuLPkzWCRQ0mIiojDDYwthrSu-gA9a-X4dPJrTHNRu1qaTcVuKHRzG1UZWR1d5E5u7spbhsaL-BHv6MvelnUqazpvOiB3dPVF-4UFF45gZJBYk Jun 15 14:51:58.723250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:51:58.723250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:51:58.723250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:51:58.723250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:51:58.723250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 14:51:58.723250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:51:58.723250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:51:58.723250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 4bf1cdbd5dc9471f9f1732600ab98c24 Jun 15 14:51:58.723250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1247917787 Jun 15 14:51:58.723250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:51:58.723250 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:51:58.724664 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4bf1cdbd5dc9471f9f1732600ab98c24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4bf1cdbd5dc9471f9f1732600ab98c24", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4bf1cdbd5dc9471f9f1732600ab98c24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4bf1cdbd5dc9471f9f1732600ab98c24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:51:58.724664 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1247917787 Jun 15 14:51:58.724664 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 4bf1cdbd5dc9471f9f1732600ab98c24 Jun 15 14:51:58.724664 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1247917787 Jun 15 14:51:58.724664 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-AttachVolumeShelveTestJSON-1247917787-project Jun 15 14:51:58.724664 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:51:58.724664 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:51:58.724664 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 1d58ac7f49454fd6a5b5eef6a1e8b2d8 Jun 15 14:51:58.724664 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1247917787-project Jun 15 14:51:58.724664 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:51:58.724664 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Instance 7d0cbdc8-d87b-4ce4-97d1-59aca342287a could not be found. Jun 15 14:51:58.724664 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': '7d0cbdc8-d87b-4ce4-97d1-59aca342287a'} Jun 15 14:51:58.725443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:51:58.725443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:58.725443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:51:58.725443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:51:58.725443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:51:58.725443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:51:58.725443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:51:58.725443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:51:58.725443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:51:58.725443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:51:58.725443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d0cbdc8-d87b-4ce4-97d1-59aca342287a could not be found. Jun 15 14:51:58.725443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:58.725443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:58.725443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:58.725443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:58.725443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:58.725443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:58.725443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:51:58.725443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:51:58.725443 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:51:58.727830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:51:58.727830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:51:58.727830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:51:58.727830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:51:58.727830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:51:58.727830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:51:58.727830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:51:58.727830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d0cbdc8-d87b-4ce4-97d1-59aca342287a could not be found. Jun 15 14:51:58.727830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:58.727830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:58.727830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:58.727830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:58.727830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:58.727830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:58.727830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:51:58.727830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:51:58.727830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d0cbdc8-d87b-4ce4-97d1-59aca342287a could not be found. Jun 15 14:51:58.727830 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:58.730332 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-72e3adf0-45d7-4775-92e8-891cf591aba6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Returning 404 to user: Instance 7d0cbdc8-d87b-4ce4-97d1-59aca342287a could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:51:58.730332 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-72e3adf0-45d7-4775-92e8-891cf591aba6 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a" status: 404 len: 111 microversion: 2.20 time: 0.029183 Jun 15 14:51:58.730332 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 539/1047] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:58 2022] GET /compute/v2.1/servers/7d0cbdc8-d87b-4ce4-97d1-59aca342287a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 14:51:58.739679 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-ace9a61a-8280-48d9-ad8c-853b0c8d7e24 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Getting quotas for project 591d111357224477998b265d45e3ee0d. Resources: {'cores', 'instances', 'ram'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:51:58.743820 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-ace9a61a-8280-48d9-ad8c-853b0c8d7e24 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Getting quotas for user 6caa64aecb914e968d057b6b593f667f and project 591d111357224477998b265d45e3ee0d. Resources: {'cores', 'instances', 'ram'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:51:58.754880 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-ace9a61a-8280-48d9-ad8c-853b0c8d7e24 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Going to run 1 instances... {{(pid=124220) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:51:58.757274 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-ace9a61a-8280-48d9-ad8c-853b0c8d7e24 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e18802bf-9dac-462c-88ba-5cce79043279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:51:58.804072 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-ace9a61a-8280-48d9-ad8c-853b0c8d7e24 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.582088 Jun 15 14:51:58.805030 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 509/1048] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 14:51:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:51:58.815423 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c2b382e6-1ea0-42fb-ba32-db4bb71fa3b6 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:58.816416 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c2b382e6-1ea0-42fb-ba32-db4bb71fa3b6 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:58.820641 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=2 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:58.887834 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c2b382e6-1ea0-42fb-ba32-db4bb71fa3b6 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:58.894639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-c2b382e6-1ea0-42fb-ba32-db4bb71fa3b6 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f" status: 200 len: 1242 microversion: 2.1 time: 0.083461 Jun 15 14:51:58.895194 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 540/1049] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:58 2022] GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:59.497944 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-778fdeb5-517c-423c-9cc5-91d42dc87944 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:59.498569 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-778fdeb5-517c-423c-9cc5-91d42dc87944 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 9c33de4c-57f5-4861-b235-9f1028907dbd] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:59.505327 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-778fdeb5-517c-423c-9cc5-91d42dc87944 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:59.505883 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-778fdeb5-517c-423c-9cc5-91d42dc87944 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:59.506680 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-778fdeb5-517c-423c-9cc5-91d42dc87944 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:59.507138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-778fdeb5-517c-423c-9cc5-91d42dc87944 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:59.650700 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-778fdeb5-517c-423c-9cc5-91d42dc87944 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:59.658779 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-778fdeb5-517c-423c-9cc5-91d42dc87944 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd" status: 200 len: 1314 microversion: 2.1 time: 0.165423 Jun 15 14:51:59.659345 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 510/1050] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:59 2022] GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:59.885782 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-2aacd6a9-f6cb-40a4-8eb4-85bb089b1269 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:59.886307 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-2aacd6a9-f6cb-40a4-8eb4-85bb089b1269 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:59.893542 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2aacd6a9-f6cb-40a4-8eb4-85bb089b1269 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:59.894027 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2aacd6a9-f6cb-40a4-8eb4-85bb089b1269 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:59.894822 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2aacd6a9-f6cb-40a4-8eb4-85bb089b1269 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:59.895271 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-2aacd6a9-f6cb-40a4-8eb4-85bb089b1269 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:59.909156 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-2aacd6a9-f6cb-40a4-8eb4-85bb089b1269 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] HTTP exception thrown: Instance 123ea48b-cb21-429c-85c6-0ae71d51c1c0 could not be found. Jun 15 14:51:59.910742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-2aacd6a9-f6cb-40a4-8eb4-85bb089b1269 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Request method failure captured: Jun 15 14:51:59.910742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: DELETE /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 HTTP/1.1 Jun 15 14:51:59.910742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:51:59.910742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:51:59.910742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:51:59.910742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:51:59.910742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:51:59.910742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:51:59.910742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:51:59.910742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:51:59.910742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfAA0mnjUk175IWqfAnuySq8diJuJh9uxnkwWapaH-5-FMWzBuA5NVj9WboUQ-ufMSuLPkzWCRQ0mIiojDDYwthrSu-gA9a-X4dPJrTHNRu1qaTcVuKHRzG1UZWR1d5E5u7spbhsaL-BHv6MvelnUqazpvOiB3dPVF-4UFF45gZJBYk Jun 15 14:51:59.910742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:51:59.910742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:51:59.910742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:51:59.910742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:51:59.910742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 14:51:59.910742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:51:59.910742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:51:59.910742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 4bf1cdbd5dc9471f9f1732600ab98c24 Jun 15 14:51:59.910742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1247917787 Jun 15 14:51:59.910742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:51:59.910742 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:51:59.912357 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4bf1cdbd5dc9471f9f1732600ab98c24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4bf1cdbd5dc9471f9f1732600ab98c24", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4bf1cdbd5dc9471f9f1732600ab98c24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4bf1cdbd5dc9471f9f1732600ab98c24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:51:59.912357 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1247917787 Jun 15 14:51:59.912357 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 4bf1cdbd5dc9471f9f1732600ab98c24 Jun 15 14:51:59.912357 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1247917787 Jun 15 14:51:59.912357 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-AttachVolumeShelveTestJSON-1247917787-project Jun 15 14:51:59.912357 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:51:59.912357 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:51:59.912357 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 1d58ac7f49454fd6a5b5eef6a1e8b2d8 Jun 15 14:51:59.912357 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1247917787-project Jun 15 14:51:59.912357 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:51:59.912357 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Instance 123ea48b-cb21-429c-85c6-0ae71d51c1c0 could not be found. Jun 15 14:51:59.912357 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': '123ea48b-cb21-429c-85c6-0ae71d51c1c0'} Jun 15 14:51:59.913473 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:51:59.913473 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:59.913473 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:51:59.913473 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:51:59.913473 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:51:59.913473 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:51:59.913473 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:51:59.913473 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:51:59.913473 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:51:59.913473 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:51:59.913473 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 123ea48b-cb21-429c-85c6-0ae71d51c1c0 could not be found. Jun 15 14:51:59.913473 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:59.913473 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:59.913473 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:59.913473 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:59.913473 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:59.913473 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:59.913473 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:51:59.913473 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:51:59.913473 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:51:59.914943 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:51:59.914943 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 14:51:59.914943 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 14:51:59.914943 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 14:51:59.914943 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 14:51:59.914943 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:51:59.914943 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:51:59.914943 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:51:59.914943 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:51:59.914943 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 123ea48b-cb21-429c-85c6-0ae71d51c1c0 could not be found. Jun 15 14:51:59.914943 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:59.914943 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:59.914943 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:59.914943 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:59.914943 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:59.914943 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:59.914943 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:51:59.914943 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:51:59.914943 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 123ea48b-cb21-429c-85c6-0ae71d51c1c0 could not be found. Jun 15 14:51:59.914943 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:59.916365 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-2aacd6a9-f6cb-40a4-8eb4-85bb089b1269 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Returning 404 to user: Instance 123ea48b-cb21-429c-85c6-0ae71d51c1c0 could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:51:59.916365 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-2aacd6a9-f6cb-40a4-8eb4-85bb089b1269 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "DELETE /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 404 len: 111 microversion: 2.20 time: 0.031004 Jun 15 14:51:59.916550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c12e6d61-d9c3-4eca-858b-af3cc6316257 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:59.916647 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 541/1051] 10.222.0.57 () {60 vars in 1279 bytes} [Wed Jun 15 14:51:59 2022] DELETE /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 14:51:59.916734 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-c12e6d61-d9c3-4eca-858b-af3cc6316257 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:59.920765 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3c846da4-2d3e-4563-85db-6962f2459fb8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:59.921408 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-3c846da4-2d3e-4563-85db-6962f2459fb8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] [instance: 123ea48b-cb21-429c-85c6-0ae71d51c1c0] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:59.922376 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c12e6d61-d9c3-4eca-858b-af3cc6316257 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:59.922830 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c12e6d61-d9c3-4eca-858b-af3cc6316257 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:59.923660 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c12e6d61-d9c3-4eca-858b-af3cc6316257 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:59.924097 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c12e6d61-d9c3-4eca-858b-af3cc6316257 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:59.927334 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3c846da4-2d3e-4563-85db-6962f2459fb8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:59.927787 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3c846da4-2d3e-4563-85db-6962f2459fb8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:59.929066 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3c846da4-2d3e-4563-85db-6962f2459fb8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:59.929516 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3c846da4-2d3e-4563-85db-6962f2459fb8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:59.942813 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-3c846da4-2d3e-4563-85db-6962f2459fb8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] HTTP exception thrown: Instance 123ea48b-cb21-429c-85c6-0ae71d51c1c0 could not be found. Jun 15 14:51:59.944982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3c846da4-2d3e-4563-85db-6962f2459fb8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Request method failure captured: Jun 15 14:51:59.944982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 HTTP/1.1 Jun 15 14:51:59.944982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:51:59.944982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:51:59.944982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:51:59.944982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:51:59.944982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:51:59.944982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:51:59.944982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:51:59.944982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:51:59.944982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfAA0mnjUk175IWqfAnuySq8diJuJh9uxnkwWapaH-5-FMWzBuA5NVj9WboUQ-ufMSuLPkzWCRQ0mIiojDDYwthrSu-gA9a-X4dPJrTHNRu1qaTcVuKHRzG1UZWR1d5E5u7spbhsaL-BHv6MvelnUqazpvOiB3dPVF-4UFF45gZJBYk Jun 15 14:51:59.944982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:51:59.944982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:51:59.944982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:51:59.944982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:51:59.944982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 14:51:59.944982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:51:59.944982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:51:59.944982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 4bf1cdbd5dc9471f9f1732600ab98c24 Jun 15 14:51:59.944982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1247917787 Jun 15 14:51:59.944982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:51:59.944982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:51:59.947234 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4bf1cdbd5dc9471f9f1732600ab98c24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4bf1cdbd5dc9471f9f1732600ab98c24", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4bf1cdbd5dc9471f9f1732600ab98c24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4bf1cdbd5dc9471f9f1732600ab98c24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:51:59.947234 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1247917787 Jun 15 14:51:59.947234 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 4bf1cdbd5dc9471f9f1732600ab98c24 Jun 15 14:51:59.947234 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1247917787 Jun 15 14:51:59.947234 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-AttachVolumeShelveTestJSON-1247917787-project Jun 15 14:51:59.947234 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:51:59.947234 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:51:59.947234 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 1d58ac7f49454fd6a5b5eef6a1e8b2d8 Jun 15 14:51:59.947234 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1247917787-project Jun 15 14:51:59.947234 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:51:59.947234 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Instance 123ea48b-cb21-429c-85c6-0ae71d51c1c0 could not be found. Jun 15 14:51:59.947234 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': '123ea48b-cb21-429c-85c6-0ae71d51c1c0'} Jun 15 14:51:59.948107 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:51:59.948107 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:59.948107 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:51:59.948107 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:51:59.948107 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:51:59.948107 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:51:59.948107 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:51:59.948107 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:51:59.948107 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:51:59.948107 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:51:59.948107 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 123ea48b-cb21-429c-85c6-0ae71d51c1c0 could not be found. Jun 15 14:51:59.948107 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:59.948107 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:59.948107 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:59.948107 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:59.948107 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:59.948107 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:59.948107 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:51:59.948107 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:51:59.948107 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:51:59.949502 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:51:59.949502 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:51:59.949502 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:51:59.949502 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:51:59.949502 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:51:59.949502 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:51:59.949502 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:51:59.949502 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 123ea48b-cb21-429c-85c6-0ae71d51c1c0 could not be found. Jun 15 14:51:59.949502 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:59.949502 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:51:59.949502 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:59.949502 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:51:59.949502 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:51:59.949502 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:51:59.949502 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:51:59.949502 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:51:59.949502 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 123ea48b-cb21-429c-85c6-0ae71d51c1c0 could not be found. Jun 15 14:51:59.949502 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:51:59.950780 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3c846da4-2d3e-4563-85db-6962f2459fb8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] Returning 404 to user: Instance 123ea48b-cb21-429c-85c6-0ae71d51c1c0 could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:51:59.950780 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-3c846da4-2d3e-4563-85db-6962f2459fb8 tempest-AttachVolumeShelveTestJSON-1247917787 tempest-AttachVolumeShelveTestJSON-1247917787-project] 10.222.0.57 "GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0" status: 404 len: 111 microversion: 2.20 time: 0.029276 Jun 15 14:51:59.950780 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 542/1052] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 14:51:59 2022] GET /compute/v2.1/servers/123ea48b-cb21-429c-85c6-0ae71d51c1c0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 14:51:59.994095 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-c12e6d61-d9c3-4eca-858b-af3cc6316257 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:00.001441 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-c12e6d61-d9c3-4eca-858b-af3cc6316257 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f" status: 200 len: 1294 microversion: 2.1 time: 0.093093 Jun 15 14:52:00.002027 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 511/1053] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:59 2022] GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f => generated 1294 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:00.675898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-004ac29a-812c-4357-ba77-9da91240ae3d tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:00.676811 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-004ac29a-812c-4357-ba77-9da91240ae3d tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 9c33de4c-57f5-4861-b235-9f1028907dbd] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:00.680407 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:00.685520 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-004ac29a-812c-4357-ba77-9da91240ae3d tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:00.686195 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-004ac29a-812c-4357-ba77-9da91240ae3d tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:00.687216 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-004ac29a-812c-4357-ba77-9da91240ae3d tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:00.687905 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-004ac29a-812c-4357-ba77-9da91240ae3d tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:00.953867 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-004ac29a-812c-4357-ba77-9da91240ae3d tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:00.961795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-004ac29a-812c-4357-ba77-9da91240ae3d tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd" status: 200 len: 1499 microversion: 2.1 time: 0.289728 Jun 15 14:52:00.962360 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 543/1054] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:00 2022] GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd => generated 1499 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:01.019381 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-330c4631-9652-4277-a65a-6fa13adaa01b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:01.020035 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-330c4631-9652-4277-a65a-6fa13adaa01b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:01.027310 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-330c4631-9652-4277-a65a-6fa13adaa01b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:01.028073 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-330c4631-9652-4277-a65a-6fa13adaa01b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:01.028846 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-330c4631-9652-4277-a65a-6fa13adaa01b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:01.029466 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-330c4631-9652-4277-a65a-6fa13adaa01b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:01.113988 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-330c4631-9652-4277-a65a-6fa13adaa01b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:01.122016 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-330c4631-9652-4277-a65a-6fa13adaa01b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f" status: 200 len: 1300 microversion: 2.1 time: 0.106827 Jun 15 14:52:01.122597 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 512/1055] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:01 2022] GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f => generated 1300 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:01.613078 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-87066a3d-06ec-40a9-ad0d-c6acbbda8bfd tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:01.613582 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-87066a3d-06ec-40a9-ad0d-c6acbbda8bfd tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 9c33de4c-57f5-4861-b235-9f1028907dbd] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:01.631369 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-87066a3d-06ec-40a9-ad0d-c6acbbda8bfd tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:01.632463 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-87066a3d-06ec-40a9-ad0d-c6acbbda8bfd tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:01.633350 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-87066a3d-06ec-40a9-ad0d-c6acbbda8bfd tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:01.634494 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-87066a3d-06ec-40a9-ad0d-c6acbbda8bfd tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:01.664901 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-87066a3d-06ec-40a9-ad0d-c6acbbda8bfd tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 9c33de4c-57f5-4861-b235-9f1028907dbd] Going to try to terminate instance {{(pid=124219) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:52:01.799930 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-87066a3d-06ec-40a9-ad0d-c6acbbda8bfd tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd" status: 204 len: 0 microversion: 2.1 time: 0.190150 Jun 15 14:52:01.800828 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 544/1056] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:52:01 2022] DELETE /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:52:01.809586 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-334a02cb-72af-42ad-adb0-70f29f99fe1f tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:01.810083 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-334a02cb-72af-42ad-adb0-70f29f99fe1f tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 9c33de4c-57f5-4861-b235-9f1028907dbd] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:01.817265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-334a02cb-72af-42ad-adb0-70f29f99fe1f tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:01.817746 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-334a02cb-72af-42ad-adb0-70f29f99fe1f tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:01.823326 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-334a02cb-72af-42ad-adb0-70f29f99fe1f tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:01.823823 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-334a02cb-72af-42ad-adb0-70f29f99fe1f tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:02.146982 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-bfa13f99-ec79-4fd0-b796-be4bffd0a5ae tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:02.150654 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-bfa13f99-ec79-4fd0-b796-be4bffd0a5ae tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:02.161069 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bfa13f99-ec79-4fd0-b796-be4bffd0a5ae tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:02.161940 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bfa13f99-ec79-4fd0-b796-be4bffd0a5ae tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:02.163589 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bfa13f99-ec79-4fd0-b796-be4bffd0a5ae tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:02.164440 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bfa13f99-ec79-4fd0-b796-be4bffd0a5ae tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:02.177478 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-334a02cb-72af-42ad-adb0-70f29f99fe1f tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:02.186988 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-334a02cb-72af-42ad-adb0-70f29f99fe1f tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd" status: 200 len: 1505 microversion: 2.1 time: 0.381446 Jun 15 14:52:02.187953 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 513/1057] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:01 2022] GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd => generated 1505 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:02.323709 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-bfa13f99-ec79-4fd0-b796-be4bffd0a5ae tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:02.332414 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-bfa13f99-ec79-4fd0-b796-be4bffd0a5ae tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f" status: 200 len: 1368 microversion: 2.1 time: 0.195946 Jun 15 14:52:02.333639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 545/1058] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:02 2022] GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f => generated 1368 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:02.831920 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-be935f46-23ff-43c3-8e1e-95623d798c6a req-f0b3017d-6534-4d56-a3b6-68554dcef007 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f35bd7e-d113-487b-9ed4-a312a5ee780f", "tag": "b6827f41-b0d7-4e45-994a-b8439850ce16"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:52:02.842594 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-be935f46-23ff-43c3-8e1e-95623d798c6a req-f0b3017d-6534-4d56-a3b6-68554dcef007 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:02.843039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-be935f46-23ff-43c3-8e1e-95623d798c6a req-f0b3017d-6534-4d56-a3b6-68554dcef007 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:02.855676 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-be935f46-23ff-43c3-8e1e-95623d798c6a req-f0b3017d-6534-4d56-a3b6-68554dcef007 service nova] Creating event network-changed:b6827f41-b0d7-4e45-994a-b8439850ce16 for instance 3f35bd7e-d113-487b-9ed4-a312a5ee780f on hv-cinder-84327 Jun 15 14:52:02.861475 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-be935f46-23ff-43c3-8e1e-95623d798c6a req-f0b3017d-6534-4d56-a3b6-68554dcef007 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035799 Jun 15 14:52:02.862424 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 514/1059] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:52:03.206183 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-7e3b0d59-1e5b-4a07-8db7-3b071576f4a0 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:03.206932 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-7e3b0d59-1e5b-4a07-8db7-3b071576f4a0 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 9c33de4c-57f5-4861-b235-9f1028907dbd] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:03.213708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7e3b0d59-1e5b-4a07-8db7-3b071576f4a0 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:03.214257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7e3b0d59-1e5b-4a07-8db7-3b071576f4a0 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:03.215086 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7e3b0d59-1e5b-4a07-8db7-3b071576f4a0 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:03.215532 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-7e3b0d59-1e5b-4a07-8db7-3b071576f4a0 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:03.352349 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-f67f5d97-205a-4065-954c-1490c1952ca1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:03.353751 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-f67f5d97-205a-4065-954c-1490c1952ca1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:03.355904 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:03.362444 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f67f5d97-205a-4065-954c-1490c1952ca1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:03.363204 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f67f5d97-205a-4065-954c-1490c1952ca1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:03.364342 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f67f5d97-205a-4065-954c-1490c1952ca1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:03.365008 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f67f5d97-205a-4065-954c-1490c1952ca1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:03.451845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-7e3b0d59-1e5b-4a07-8db7-3b071576f4a0 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:03.462055 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-7e3b0d59-1e5b-4a07-8db7-3b071576f4a0 tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd" status: 200 len: 1505 microversion: 2.1 time: 0.260792 Jun 15 14:52:03.462980 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 546/1060] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:03 2022] GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd => generated 1505 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:03.579768 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-f67f5d97-205a-4065-954c-1490c1952ca1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:03.587971 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-f67f5d97-205a-4065-954c-1490c1952ca1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f" status: 200 len: 1368 microversion: 2.1 time: 0.241758 Jun 15 14:52:03.588803 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 515/1061] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:03 2022] GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:04.479921 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-b4598a04-91d6-421b-8ae8-dd84b017570e tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:04.480531 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-b4598a04-91d6-421b-8ae8-dd84b017570e tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 9c33de4c-57f5-4861-b235-9f1028907dbd] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:04.487497 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b4598a04-91d6-421b-8ae8-dd84b017570e tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:04.488179 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b4598a04-91d6-421b-8ae8-dd84b017570e tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:04.489191 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b4598a04-91d6-421b-8ae8-dd84b017570e tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:04.489870 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b4598a04-91d6-421b-8ae8-dd84b017570e tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:04.605442 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-41785641-52f0-40f2-a879-ea9f2b530341 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:04.606097 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-41785641-52f0-40f2-a879-ea9f2b530341 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:04.613429 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-41785641-52f0-40f2-a879-ea9f2b530341 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:04.613902 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-41785641-52f0-40f2-a879-ea9f2b530341 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:04.614735 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-41785641-52f0-40f2-a879-ea9f2b530341 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:04.615183 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-41785641-52f0-40f2-a879-ea9f2b530341 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:04.763263 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-41785641-52f0-40f2-a879-ea9f2b530341 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:04.770762 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-41785641-52f0-40f2-a879-ea9f2b530341 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f" status: 200 len: 1368 microversion: 2.1 time: 0.169821 Jun 15 14:52:04.780513 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 516/1062] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:04 2022] GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:04.812446 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b4598a04-91d6-421b-8ae8-dd84b017570e tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:04.822078 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-b4598a04-91d6-421b-8ae8-dd84b017570e tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd" status: 200 len: 1505 microversion: 2.1 time: 0.346638 Jun 15 14:52:04.823346 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 547/1063] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:04 2022] GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd => generated 1505 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:04.837934 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-86bca52b-41d7-423b-89e7-0268cb01a0c6 req-fed5c694-30d5-48c2-a79a-613d26f89518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c33de4c-57f5-4861-b235-9f1028907dbd", "name": "network-vif-deleted", "tag": "32920329-8983-4739-8d2a-dd1279e15085"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:52:04.846808 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-86bca52b-41d7-423b-89e7-0268cb01a0c6 req-fed5c694-30d5-48c2-a79a-613d26f89518 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:04.847454 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-86bca52b-41d7-423b-89e7-0268cb01a0c6 req-fed5c694-30d5-48c2-a79a-613d26f89518 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:04.859528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-86bca52b-41d7-423b-89e7-0268cb01a0c6 req-fed5c694-30d5-48c2-a79a-613d26f89518 service nova] Creating event network-vif-deleted:32920329-8983-4739-8d2a-dd1279e15085 for instance 9c33de4c-57f5-4861-b235-9f1028907dbd on hv-cinder-84327 Jun 15 14:52:04.864246 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-86bca52b-41d7-423b-89e7-0268cb01a0c6 req-fed5c694-30d5-48c2-a79a-613d26f89518 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033504 Jun 15 14:52:04.864827 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 517/1064] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:52:05.788158 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-79482977-d83f-435a-87a8-224a0cb6e198 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:05.788810 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-79482977-d83f-435a-87a8-224a0cb6e198 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:05.795197 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-79482977-d83f-435a-87a8-224a0cb6e198 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:05.795650 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-79482977-d83f-435a-87a8-224a0cb6e198 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:05.796410 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-79482977-d83f-435a-87a8-224a0cb6e198 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:05.796849 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-79482977-d83f-435a-87a8-224a0cb6e198 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:05.841274 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-bbe897ff-147c-4339-9d00-93ce02f594fa tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:05.842012 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-bbe897ff-147c-4339-9d00-93ce02f594fa tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 9c33de4c-57f5-4861-b235-9f1028907dbd] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:05.848350 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-bbe897ff-147c-4339-9d00-93ce02f594fa tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:05.849231 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-bbe897ff-147c-4339-9d00-93ce02f594fa tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:05.850305 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-bbe897ff-147c-4339-9d00-93ce02f594fa tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:05.851083 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-bbe897ff-147c-4339-9d00-93ce02f594fa tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:05.885588 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-bbe897ff-147c-4339-9d00-93ce02f594fa tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:05.886067 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-bbe897ff-147c-4339-9d00-93ce02f594fa tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:05.886522 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.objects.instance [None req-bbe897ff-147c-4339-9d00-93ce02f594fa tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lazy-loading 'fault' on Instance uuid 9c33de4c-57f5-4861-b235-9f1028907dbd {{(pid=124220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:52:05.931841 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-bbe897ff-147c-4339-9d00-93ce02f594fa tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f839b774b249dd9d7d3061feb2cd41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d40b771f30d4e668e0c908fbd0da517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:05.940738 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-bbe897ff-147c-4339-9d00-93ce02f594fa tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd" status: 200 len: 1304 microversion: 2.1 time: 0.104384 Jun 15 14:52:05.941525 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 518/1065] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:05 2022] GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:05.945474 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-79482977-d83f-435a-87a8-224a0cb6e198 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:05.953419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-79482977-d83f-435a-87a8-224a0cb6e198 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f" status: 200 len: 1368 microversion: 2.1 time: 0.169111 Jun 15 14:52:05.954021 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 548/1066] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:05 2022] GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:06.959294 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1c6a4af0-ffbb-4010-8c92-6fd4d90206dc tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:06.959757 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1c6a4af0-ffbb-4010-8c92-6fd4d90206dc tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] [instance: 9c33de4c-57f5-4861-b235-9f1028907dbd] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:06.967734 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1c6a4af0-ffbb-4010-8c92-6fd4d90206dc tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:06.968244 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1c6a4af0-ffbb-4010-8c92-6fd4d90206dc tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:06.969047 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1c6a4af0-ffbb-4010-8c92-6fd4d90206dc tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:06.969486 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1c6a4af0-ffbb-4010-8c92-6fd4d90206dc tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:06.972626 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-9b7de4c8-5fe3-44c8-8e9c-66018f1999a7 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:06.973506 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-9b7de4c8-5fe3-44c8-8e9c-66018f1999a7 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:06.982154 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9b7de4c8-5fe3-44c8-8e9c-66018f1999a7 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:06.982650 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9b7de4c8-5fe3-44c8-8e9c-66018f1999a7 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:06.983467 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9b7de4c8-5fe3-44c8-8e9c-66018f1999a7 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:06.983929 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9b7de4c8-5fe3-44c8-8e9c-66018f1999a7 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:06.984412 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.wsgi [None req-1c6a4af0-ffbb-4010-8c92-6fd4d90206dc tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] HTTP exception thrown: Instance 9c33de4c-57f5-4861-b235-9f1028907dbd could not be found. Jun 15 14:52:06.986166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1c6a4af0-ffbb-4010-8c92-6fd4d90206dc tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Request method failure captured: Jun 15 14:52:06.986166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: request: GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd HTTP/1.1 Jun 15 14:52:06.986166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept: application/json Jun 15 14:52:06.986166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept-Encoding: identity Jun 15 14:52:06.986166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Connection: close Jun 15 14:52:06.986166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Length: 0 Jun 15 14:52:06.986166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Type: application/json Jun 15 14:52:06.986166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Host: 10.222.0.57 Jun 15 14:52:06.986166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Openstack-System-Scope: None Jun 15 14:52:06.986166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: User-Agent: python-urllib3/1.26.9 Jun 15 14:52:06.986166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Auth-Token: gAAAAABiqfHzX4pVY6jv15w46JmKJR5tXnJN8kSaau1dE0OzyjqrNisw9yVg1qJ1_fQIsEAgBr-c67D6MO2gD00HTObel4qCAWBYQEj6NQWGt9b0TkgVp9BqRUFWsAyN9QBUSQTgxky-8VU_41mSNva4pmZBO7cZHAg5dZAOe53xrrqqhdojwlU Jun 15 14:52:06.986166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Id: None Jun 15 14:52:06.986166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Name: None Jun 15 14:52:06.986166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Identity-Status: Confirmed Jun 15 14:52:06.986166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Is-Admin-Project: True Jun 15 14:52:06.986166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Id: default Jun 15 14:52:06.986166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Name: Default Jun 15 14:52:06.986166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Id: 8d40b771f30d4e668e0c908fbd0da517 Jun 15 14:52:06.986166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Name: tempest-VolumesActionsTest-812455990 Jun 15 14:52:06.986166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Role: member,reader Jun 15 14:52:06.986166 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Roles: member,reader Jun 15 14:52:06.988393 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8d40b771f30d4e668e0c908fbd0da517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8d40b771f30d4e668e0c908fbd0da517", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8d40b771f30d4e668e0c908fbd0da517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8d40b771f30d4e668e0c908fbd0da517"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:52:06.988393 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant: tempest-VolumesActionsTest-812455990 Jun 15 14:52:06.988393 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Id: 8d40b771f30d4e668e0c908fbd0da517 Jun 15 14:52:06.988393 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Name: tempest-VolumesActionsTest-812455990 Jun 15 14:52:06.988393 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User: tempest-VolumesActionsTest-812455990-project Jun 15 14:52:06.988393 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Id: default Jun 15 14:52:06.988393 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Name: Default Jun 15 14:52:06.988393 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Id: 44f839b774b249dd9d7d3061feb2cd41 Jun 15 14:52:06.988393 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Name: tempest-VolumesActionsTest-812455990-project Jun 15 14:52:06.988393 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: method: > Jun 15 14:52:06.988393 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: exception: Instance 9c33de4c-57f5-4861-b235-9f1028907dbd could not be found. Jun 15 14:52:06.988393 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: action_args: {'id': '9c33de4c-57f5-4861-b235-9f1028907dbd'} Jun 15 14:52:06.989811 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:52:06.989811 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:06.989811 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:52:06.989811 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:52:06.989811 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:52:06.989811 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:52:06.989811 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:52:06.989811 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:52:06.989811 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:52:06.989811 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:52:06.989811 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c33de4c-57f5-4861-b235-9f1028907dbd could not be found. Jun 15 14:52:06.989811 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:52:06.989811 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:52:06.989811 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:52:06.989811 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:06.989811 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:52:06.989811 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:52:06.989811 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:52:06.989811 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:52:06.989811 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:52:06.998019 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:52:06.998019 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:52:06.998019 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:52:06.998019 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:52:06.998019 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:52:06.998019 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:52:06.998019 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:52:06.998019 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c33de4c-57f5-4861-b235-9f1028907dbd could not be found. Jun 15 14:52:06.998019 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:52:06.998019 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:52:06.998019 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:52:06.998019 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:06.998019 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:52:06.998019 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:52:06.998019 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:52:06.998019 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:52:06.998019 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c33de4c-57f5-4861-b235-9f1028907dbd could not be found. Jun 15 14:52:06.998019 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:52:07.000570 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1c6a4af0-ffbb-4010-8c92-6fd4d90206dc tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] Returning 404 to user: Instance 9c33de4c-57f5-4861-b235-9f1028907dbd could not be found. {{(pid=124220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:52:07.000570 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-1c6a4af0-ffbb-4010-8c92-6fd4d90206dc tempest-VolumesActionsTest-812455990 tempest-VolumesActionsTest-812455990-project] 10.222.0.57 "GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd" status: 404 len: 111 microversion: 2.1 time: 0.032680 Jun 15 14:52:07.000570 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 519/1067] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:06 2022] GET /compute/v2.1/servers/9c33de4c-57f5-4861-b235-9f1028907dbd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:52:07.141354 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-9b7de4c8-5fe3-44c8-8e9c-66018f1999a7 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:07.157756 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-9b7de4c8-5fe3-44c8-8e9c-66018f1999a7 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f" status: 200 len: 1368 microversion: 2.1 time: 0.189122 Jun 15 14:52:07.158587 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 549/1068] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:06 2022] GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:08.175280 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-19e29fe7-f951-4538-a16b-f2eb0949c224 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:08.175970 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-19e29fe7-f951-4538-a16b-f2eb0949c224 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:08.183466 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-19e29fe7-f951-4538-a16b-f2eb0949c224 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:08.183916 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-19e29fe7-f951-4538-a16b-f2eb0949c224 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:08.184799 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-19e29fe7-f951-4538-a16b-f2eb0949c224 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:08.185300 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-19e29fe7-f951-4538-a16b-f2eb0949c224 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:08.327013 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-19e29fe7-f951-4538-a16b-f2eb0949c224 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:08.339665 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-19e29fe7-f951-4538-a16b-f2eb0949c224 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f" status: 200 len: 1368 microversion: 2.1 time: 0.168154 Jun 15 14:52:08.340401 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 520/1069] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:08 2022] GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:09.357269 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3caa0eee-b834-4f44-8f53-284ccea8059e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:09.357925 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-3caa0eee-b834-4f44-8f53-284ccea8059e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:09.360454 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=12 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:09.365835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3caa0eee-b834-4f44-8f53-284ccea8059e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:09.366315 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3caa0eee-b834-4f44-8f53-284ccea8059e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:09.367096 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3caa0eee-b834-4f44-8f53-284ccea8059e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:09.367534 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3caa0eee-b834-4f44-8f53-284ccea8059e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:09.507301 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-3caa0eee-b834-4f44-8f53-284ccea8059e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:09.514973 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-3caa0eee-b834-4f44-8f53-284ccea8059e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f" status: 200 len: 1368 microversion: 2.1 time: 0.162318 Jun 15 14:52:09.515535 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 550/1070] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:09 2022] GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:10.532689 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-24899b54-13e9-476e-b44c-384fb0ceffa4 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:10.533306 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-24899b54-13e9-476e-b44c-384fb0ceffa4 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:10.535304 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=2 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:10.535962 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=8 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:10.542699 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-24899b54-13e9-476e-b44c-384fb0ceffa4 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:10.543153 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-24899b54-13e9-476e-b44c-384fb0ceffa4 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:10.543929 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-24899b54-13e9-476e-b44c-384fb0ceffa4 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:10.544369 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-24899b54-13e9-476e-b44c-384fb0ceffa4 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:10.677278 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-24899b54-13e9-476e-b44c-384fb0ceffa4 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:10.685628 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-24899b54-13e9-476e-b44c-384fb0ceffa4 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f" status: 200 len: 1368 microversion: 2.1 time: 0.157123 Jun 15 14:52:10.689859 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 521/1071] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:10 2022] GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:11.499016 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-b3e9af80-4bb2-4e47-828e-06617878a714 req-3d9eb4cc-784e-44f3-bc83-169b04537231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f35bd7e-d113-487b-9ed4-a312a5ee780f", "name": "network-vif-plugged", "status": "completed", "tag": "b6827f41-b0d7-4e45-994a-b8439850ce16"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:52:11.507731 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-b3e9af80-4bb2-4e47-828e-06617878a714 req-3d9eb4cc-784e-44f3-bc83-169b04537231 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:11.508503 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-b3e9af80-4bb2-4e47-828e-06617878a714 req-3d9eb4cc-784e-44f3-bc83-169b04537231 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:11.520606 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-b3e9af80-4bb2-4e47-828e-06617878a714 req-3d9eb4cc-784e-44f3-bc83-169b04537231 service nova] Creating event network-vif-plugged:b6827f41-b0d7-4e45-994a-b8439850ce16 for instance 3f35bd7e-d113-487b-9ed4-a312a5ee780f on hv-cinder-84327 Jun 15 14:52:11.526681 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-b3e9af80-4bb2-4e47-828e-06617878a714 req-3d9eb4cc-784e-44f3-bc83-169b04537231 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031473 Jun 15 14:52:11.527664 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 551/1072] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:52:11.705949 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6dacf0b8-0040-4582-ae13-c02bcbdc72f3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:11.709769 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6dacf0b8-0040-4582-ae13-c02bcbdc72f3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:11.721570 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6dacf0b8-0040-4582-ae13-c02bcbdc72f3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:11.722351 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6dacf0b8-0040-4582-ae13-c02bcbdc72f3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:11.723288 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6dacf0b8-0040-4582-ae13-c02bcbdc72f3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:11.723880 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6dacf0b8-0040-4582-ae13-c02bcbdc72f3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:11.962382 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6dacf0b8-0040-4582-ae13-c02bcbdc72f3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:11.975528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-6dacf0b8-0040-4582-ae13-c02bcbdc72f3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f" status: 200 len: 1368 microversion: 2.1 time: 0.275094 Jun 15 14:52:11.976512 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 522/1073] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:11 2022] GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f => generated 1368 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:12.618495 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-176a7914-eb0e-46ed-8a99-dc617902ee70 req-9c0a182a-5af9-49c5-bcd7-4aa26ac7aac6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fdd6732-ba3a-4243-a57f-7e84f8eea531", "tag": "457c9267-d5cd-492d-9292-3d4518f9d2bb"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:52:12.625360 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-5e4c06e5-95a7-471e-b148-f18f9412bbd3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:12.625905 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-5e4c06e5-95a7-471e-b148-f18f9412bbd3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:12.651513 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-176a7914-eb0e-46ed-8a99-dc617902ee70 req-9c0a182a-5af9-49c5-bcd7-4aa26ac7aac6 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:12.652048 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-176a7914-eb0e-46ed-8a99-dc617902ee70 req-9c0a182a-5af9-49c5-bcd7-4aa26ac7aac6 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:12.652763 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5e4c06e5-95a7-471e-b148-f18f9412bbd3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:12.653233 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5e4c06e5-95a7-471e-b148-f18f9412bbd3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:12.656282 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5e4c06e5-95a7-471e-b148-f18f9412bbd3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:12.656737 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5e4c06e5-95a7-471e-b148-f18f9412bbd3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:12.675762 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-176a7914-eb0e-46ed-8a99-dc617902ee70 req-9c0a182a-5af9-49c5-bcd7-4aa26ac7aac6 service nova] Creating event network-changed:457c9267-d5cd-492d-9292-3d4518f9d2bb for instance 3fdd6732-ba3a-4243-a57f-7e84f8eea531 on hv-cinder-84327 Jun 15 14:52:12.683443 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-176a7914-eb0e-46ed-8a99-dc617902ee70 req-9c0a182a-5af9-49c5-bcd7-4aa26ac7aac6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068409 Jun 15 14:52:12.684756 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 523/1074] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:52:12.713612 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-5e4c06e5-95a7-471e-b148-f18f9412bbd3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Going to try to terminate instance {{(pid=124219) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:52:12.739898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:12.919890 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-5e4c06e5-95a7-471e-b148-f18f9412bbd3 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 204 len: 0 microversion: 2.1 time: 0.306775 Jun 15 14:52:12.921145 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 552/1075] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:52:12 2022] DELETE /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:52:12.931970 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a4389bb1-9114-4abc-a0af-d27932c30a56 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:12.934226 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a4389bb1-9114-4abc-a0af-d27932c30a56 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:12.950999 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a4389bb1-9114-4abc-a0af-d27932c30a56 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:12.952087 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a4389bb1-9114-4abc-a0af-d27932c30a56 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:12.953156 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a4389bb1-9114-4abc-a0af-d27932c30a56 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:12.953995 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a4389bb1-9114-4abc-a0af-d27932c30a56 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:12.995222 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c7fff10b-5624-40b7-9dca-b910fd1d1eea tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:12.995988 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c7fff10b-5624-40b7-9dca-b910fd1d1eea tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:13.029015 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c7fff10b-5624-40b7-9dca-b910fd1d1eea tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:13.029532 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c7fff10b-5624-40b7-9dca-b910fd1d1eea tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:13.030452 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c7fff10b-5624-40b7-9dca-b910fd1d1eea tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:13.030940 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c7fff10b-5624-40b7-9dca-b910fd1d1eea tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:13.274946 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a4389bb1-9114-4abc-a0af-d27932c30a56 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:13.298679 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a4389bb1-9114-4abc-a0af-d27932c30a56 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1566 microversion: 2.1 time: 0.372473 Jun 15 14:52:13.298872 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c7fff10b-5624-40b7-9dca-b910fd1d1eea tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:13.300321 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 524/1076] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:12 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1566 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:13.322162 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-c7fff10b-5624-40b7-9dca-b910fd1d1eea tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f" status: 200 len: 1368 microversion: 2.1 time: 0.333164 Jun 15 14:52:13.324056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 553/1077] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:12 2022] GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f => generated 1368 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:14.321934 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-392148f2-c0f1-4b37-82c4-835158d2b347 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:14.322623 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-392148f2-c0f1-4b37-82c4-835158d2b347 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:14.332863 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-392148f2-c0f1-4b37-82c4-835158d2b347 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:14.333607 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-392148f2-c0f1-4b37-82c4-835158d2b347 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:14.336148 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-392148f2-c0f1-4b37-82c4-835158d2b347 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:14.336951 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-392148f2-c0f1-4b37-82c4-835158d2b347 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:14.340616 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-ad2cda43-0b70-4d3d-883a-ab97cb8d68df tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:14.341313 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-ad2cda43-0b70-4d3d-883a-ab97cb8d68df tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:14.359735 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ad2cda43-0b70-4d3d-883a-ab97cb8d68df tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:14.362636 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ad2cda43-0b70-4d3d-883a-ab97cb8d68df tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:14.363651 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ad2cda43-0b70-4d3d-883a-ab97cb8d68df tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:14.364631 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ad2cda43-0b70-4d3d-883a-ab97cb8d68df tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:14.551595 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-392148f2-c0f1-4b37-82c4-835158d2b347 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:14.560635 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-392148f2-c0f1-4b37-82c4-835158d2b347 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1566 microversion: 2.1 time: 0.243718 Jun 15 14:52:14.561450 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 525/1078] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:14 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1566 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:14.619656 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-ad2cda43-0b70-4d3d-883a-ab97cb8d68df tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:14.633676 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-ad2cda43-0b70-4d3d-883a-ab97cb8d68df tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f" status: 200 len: 1368 microversion: 2.1 time: 0.297433 Jun 15 14:52:14.635072 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 554/1079] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:14 2022] GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f => generated 1368 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:15.583357 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-eb55ac65-348f-4368-b1f6-3b236f5b60ea tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:15.584387 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-eb55ac65-348f-4368-b1f6-3b236f5b60ea tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:15.592933 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-eb55ac65-348f-4368-b1f6-3b236f5b60ea tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:15.594077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-eb55ac65-348f-4368-b1f6-3b236f5b60ea tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:15.595323 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-eb55ac65-348f-4368-b1f6-3b236f5b60ea tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:15.595843 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-eb55ac65-348f-4368-b1f6-3b236f5b60ea tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:15.657722 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-154c371f-fccf-42f1-85e7-07bc56ea71dd tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:15.658346 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-154c371f-fccf-42f1-85e7-07bc56ea71dd tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:15.684144 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-154c371f-fccf-42f1-85e7-07bc56ea71dd tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:15.684896 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-154c371f-fccf-42f1-85e7-07bc56ea71dd tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:15.686242 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-154c371f-fccf-42f1-85e7-07bc56ea71dd tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:15.694351 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-154c371f-fccf-42f1-85e7-07bc56ea71dd tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:15.819349 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-eb55ac65-348f-4368-b1f6-3b236f5b60ea tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:15.830515 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-eb55ac65-348f-4368-b1f6-3b236f5b60ea tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1566 microversion: 2.1 time: 0.253175 Jun 15 14:52:15.831086 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 526/1080] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:15 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1566 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:15.999280 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-154c371f-fccf-42f1-85e7-07bc56ea71dd tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:16.011751 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-154c371f-fccf-42f1-85e7-07bc56ea71dd tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f" status: 200 len: 1558 microversion: 2.1 time: 0.362221 Jun 15 14:52:16.013154 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 555/1081] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:15 2022] GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f => generated 1558 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:16.031244 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-9600a5ec-1123-42bf-b28f-3c87a7d225ab tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:16.031941 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-9600a5ec-1123-42bf-b28f-3c87a7d225ab tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:16.043255 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9600a5ec-1123-42bf-b28f-3c87a7d225ab tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:16.043717 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9600a5ec-1123-42bf-b28f-3c87a7d225ab tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:16.044547 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9600a5ec-1123-42bf-b28f-3c87a7d225ab tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:16.044993 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9600a5ec-1123-42bf-b28f-3c87a7d225ab tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:16.215699 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-9600a5ec-1123-42bf-b28f-3c87a7d225ab tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.188966 Jun 15 14:52:16.224369 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 527/1082] 10.222.0.57 () {58 vars in 1274 bytes} [Wed Jun 15 14:52:16 2022] GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f/os-interface => generated 284 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:52:16.848860 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-946d0678-f342-4740-8bde-172a2b851d30 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:16.849475 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-946d0678-f342-4740-8bde-172a2b851d30 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:16.856759 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-946d0678-f342-4740-8bde-172a2b851d30 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:16.857485 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-946d0678-f342-4740-8bde-172a2b851d30 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:16.858493 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-946d0678-f342-4740-8bde-172a2b851d30 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:16.859754 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-946d0678-f342-4740-8bde-172a2b851d30 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:16.961019 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-946d0678-f342-4740-8bde-172a2b851d30 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:16.971711 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-946d0678-f342-4740-8bde-172a2b851d30 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1380 microversion: 2.1 time: 0.126673 Jun 15 14:52:16.972833 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 556/1083] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:16 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1380 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:17.010221 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-9d35b7e0-ac32-4567-8364-66be9523a8ca req-b192e756-22d0-43da-b73c-d8d7d7a06036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fdd6732-ba3a-4243-a57f-7e84f8eea531", "name": "network-vif-deleted", "tag": "457c9267-d5cd-492d-9292-3d4518f9d2bb"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:52:17.023731 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-9d35b7e0-ac32-4567-8364-66be9523a8ca req-b192e756-22d0-43da-b73c-d8d7d7a06036 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:17.024179 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-9d35b7e0-ac32-4567-8364-66be9523a8ca req-b192e756-22d0-43da-b73c-d8d7d7a06036 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:17.029255 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=100 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:17.040221 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-9d35b7e0-ac32-4567-8364-66be9523a8ca req-b192e756-22d0-43da-b73c-d8d7d7a06036 service nova] Creating event network-vif-deleted:457c9267-d5cd-492d-9292-3d4518f9d2bb for instance 3fdd6732-ba3a-4243-a57f-7e84f8eea531 on hv-cinder-84327 Jun 15 14:52:17.047252 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-9d35b7e0-ac32-4567-8364-66be9523a8ca req-b192e756-22d0-43da-b73c-d8d7d7a06036 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042802 Jun 15 14:52:17.048405 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 528/1084] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:52:17.996949 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3bf88cd7-34c3-4d97-87bd-e48baaf9575f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:17.998271 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-3bf88cd7-34c3-4d97-87bd-e48baaf9575f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:18.029708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3bf88cd7-34c3-4d97-87bd-e48baaf9575f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:18.030295 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3bf88cd7-34c3-4d97-87bd-e48baaf9575f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:18.033887 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3bf88cd7-34c3-4d97-87bd-e48baaf9575f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:18.034642 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3bf88cd7-34c3-4d97-87bd-e48baaf9575f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:18.093224 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3bf88cd7-34c3-4d97-87bd-e48baaf9575f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:18.093964 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3bf88cd7-34c3-4d97-87bd-e48baaf9575f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:18.095364 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.objects.instance [None req-3bf88cd7-34c3-4d97-87bd-e48baaf9575f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lazy-loading 'fault' on Instance uuid 3fdd6732-ba3a-4243-a57f-7e84f8eea531 {{(pid=124219) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:52:18.150990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-3bf88cd7-34c3-4d97-87bd-e48baaf9575f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c10fc72dc44e59030216239fc678d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a3fa88f5ea4fa2940733b09cbc835a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:18.161139 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-3bf88cd7-34c3-4d97-87bd-e48baaf9575f tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 200 len: 1223 microversion: 2.1 time: 0.172946 Jun 15 14:52:18.162622 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 557/1085] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:17 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 1223 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:19.068159 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-55ab79e5-4220-4d0c-a0b9-84fb96064f39 req-5fdef5c6-d868-4a82-a0f0-f0ac19ded736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f35bd7e-d113-487b-9ed4-a312a5ee780f", "tag": "b6827f41-b0d7-4e45-994a-b8439850ce16"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:52:19.085956 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-55ab79e5-4220-4d0c-a0b9-84fb96064f39 req-5fdef5c6-d868-4a82-a0f0-f0ac19ded736 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:19.086765 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-55ab79e5-4220-4d0c-a0b9-84fb96064f39 req-5fdef5c6-d868-4a82-a0f0-f0ac19ded736 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:19.098709 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-55ab79e5-4220-4d0c-a0b9-84fb96064f39 req-5fdef5c6-d868-4a82-a0f0-f0ac19ded736 service nova] Creating event network-changed:b6827f41-b0d7-4e45-994a-b8439850ce16 for instance 3f35bd7e-d113-487b-9ed4-a312a5ee780f on hv-cinder-84327 Jun 15 14:52:19.104625 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-55ab79e5-4220-4d0c-a0b9-84fb96064f39 req-5fdef5c6-d868-4a82-a0f0-f0ac19ded736 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041057 Jun 15 14:52:19.105445 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 529/1086] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:52:19.181100 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-83da16b9-d47f-4c30-a68b-66181a565ede tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:19.182501 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-83da16b9-d47f-4c30-a68b-66181a565ede tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] [instance: 3fdd6732-ba3a-4243-a57f-7e84f8eea531] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:19.189976 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-83da16b9-d47f-4c30-a68b-66181a565ede tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:19.190734 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-83da16b9-d47f-4c30-a68b-66181a565ede tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:19.191716 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-83da16b9-d47f-4c30-a68b-66181a565ede tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:19.192351 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-83da16b9-d47f-4c30-a68b-66181a565ede tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:19.208385 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-83da16b9-d47f-4c30-a68b-66181a565ede tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] HTTP exception thrown: Instance 3fdd6732-ba3a-4243-a57f-7e84f8eea531 could not be found. Jun 15 14:52:19.210289 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-83da16b9-d47f-4c30-a68b-66181a565ede tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Request method failure captured: Jun 15 14:52:19.210289 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 HTTP/1.1 Jun 15 14:52:19.210289 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:52:19.210289 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:52:19.210289 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:52:19.210289 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:52:19.210289 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:52:19.210289 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:52:19.210289 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:52:19.210289 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:52:19.210289 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfCuac6gxCAS8pkxQWu-u2XHpTBbIgee1ucUoSbkENEc9qN6osrcWMYpDIx_9KIl_0sV6EhN7Aw3Y7J0zThitiXtDTcLEudi3Qmug5aNqBhM2J5cFK3ZV8HaBYzlmTp_CEz_f5HrBlKTmiBmlBmzDVHx06DzTBVyiqV1ER-ld1tkpwo Jun 15 14:52:19.210289 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:52:19.210289 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:52:19.210289 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:52:19.210289 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:52:19.210289 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:52:19.210289 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:52:19.210289 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 79a3fa88f5ea4fa2940733b09cbc835a Jun 15 14:52:19.210289 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-TestShelveInstance-1869592443 Jun 15 14:52:19.210289 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:52:19.210289 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:52:19.211776 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/79a3fa88f5ea4fa2940733b09cbc835a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_79a3fa88f5ea4fa2940733b09cbc835a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/79a3fa88f5ea4fa2940733b09cbc835a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/79a3fa88f5ea4fa2940733b09cbc835a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:52:19.211776 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-TestShelveInstance-1869592443 Jun 15 14:52:19.211776 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 79a3fa88f5ea4fa2940733b09cbc835a Jun 15 14:52:19.211776 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-TestShelveInstance-1869592443 Jun 15 14:52:19.211776 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-TestShelveInstance-1869592443-project Jun 15 14:52:19.211776 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:52:19.211776 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:52:19.211776 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: af5c10fc72dc44e59030216239fc678d Jun 15 14:52:19.211776 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-TestShelveInstance-1869592443-project Jun 15 14:52:19.211776 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:52:19.211776 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Instance 3fdd6732-ba3a-4243-a57f-7e84f8eea531 could not be found. Jun 15 14:52:19.211776 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': '3fdd6732-ba3a-4243-a57f-7e84f8eea531'} Jun 15 14:52:19.212528 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:52:19.212528 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:19.212528 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:52:19.212528 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:52:19.212528 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:52:19.212528 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:52:19.212528 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:52:19.212528 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:52:19.212528 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:52:19.212528 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:52:19.212528 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fdd6732-ba3a-4243-a57f-7e84f8eea531 could not be found. Jun 15 14:52:19.212528 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:52:19.212528 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:52:19.212528 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:52:19.212528 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:19.212528 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:52:19.212528 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:52:19.212528 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:52:19.212528 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:52:19.212528 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:52:19.213793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:52:19.213793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:52:19.213793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:52:19.213793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:52:19.213793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:52:19.213793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:52:19.213793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:52:19.213793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fdd6732-ba3a-4243-a57f-7e84f8eea531 could not be found. Jun 15 14:52:19.213793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:52:19.213793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:52:19.213793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:52:19.213793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:19.213793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:52:19.213793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:52:19.213793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:52:19.213793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:52:19.213793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fdd6732-ba3a-4243-a57f-7e84f8eea531 could not be found. Jun 15 14:52:19.213793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:52:19.216848 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-83da16b9-d47f-4c30-a68b-66181a565ede tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Returning 404 to user: Instance 3fdd6732-ba3a-4243-a57f-7e84f8eea531 could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:52:19.218005 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-83da16b9-d47f-4c30-a68b-66181a565ede tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531" status: 404 len: 111 microversion: 2.1 time: 0.041618 Jun 15 14:52:19.218960 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 558/1087] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:19 2022] GET /compute/v2.1/servers/3fdd6732-ba3a-4243-a57f-7e84f8eea531 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:52:19.423703 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-154684e6-9582-4e59-b703-6e760e03c046 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] Calling method '.version_select at 0x7f8f13457820>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:19.444112 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-154684e6-9582-4e59-b703-6e760e03c046 tempest-TestShelveInstance-1869592443 tempest-TestShelveInstance-1869592443-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-669145631" status: 202 len: 0 microversion: 2.1 time: 0.024583 Jun 15 14:52:19.445042 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 530/1088] 10.222.0.57 () {58 vars in 1250 bytes} [Wed Jun 15 14:52:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-669145631 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:52:36.891169 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-113468b2-03e6-44b3-be97-77f17ab36132 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1126138213", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1261933231", "security_groups": [{"name": "tempest-secgroup-smoke-499501397"}], "block_device_mapping_v2": [{"uuid": "eb0c1e49-c1b5-4adf-b695-2ace72c143d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e7b389d2-b470-4005-95f3-38993d2e4479"}]}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:52:36.899442 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=2 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:36.900085 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:37.006998 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.network.neutron [None req-113468b2-03e6-44b3-be97-77f17ab36132 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] validate_networks() for [('e7b389d2-b470-4005-95f3-38993d2e4479', None, None, None, None, None)] {{(pid=124219) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:52:37.385911 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-113468b2-03e6-44b3-be97-77f17ab36132 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Flavor limits 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:52:37.386333 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-113468b2-03e6-44b3-be97-77f17ab36132 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Image limits 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:52:37.386803 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-113468b2-03e6-44b3-be97-77f17ab36132 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Flavor pref 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:52:37.387327 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-113468b2-03e6-44b3-be97-77f17ab36132 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Image pref 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:52:37.388189 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-113468b2-03e6-44b3-be97-77f17ab36132 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:52:37.396954 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-113468b2-03e6-44b3-be97-77f17ab36132 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:37.397397 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-113468b2-03e6-44b3-be97-77f17ab36132 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:37.398217 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-113468b2-03e6-44b3-be97-77f17ab36132 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:37.398650 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-113468b2-03e6-44b3-be97-77f17ab36132 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:37.416684 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-113468b2-03e6-44b3-be97-77f17ab36132 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Getting quotas for project 2350f7b62a7d4d8199faf8b18b2ca8dc. Resources: {'cores', 'instances', 'ram'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:52:37.422057 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-113468b2-03e6-44b3-be97-77f17ab36132 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Getting quotas for user 67d64cad336c44d28c9cf31fc9896854 and project 2350f7b62a7d4d8199faf8b18b2ca8dc. Resources: {'cores', 'instances', 'ram'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:52:37.487423 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-113468b2-03e6-44b3-be97-77f17ab36132 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Going to run 1 instances... {{(pid=124219) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:52:37.489626 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-113468b2-03e6-44b3-be97-77f17ab36132 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb0c1e49-c1b5-4adf-b695-2ace72c143d8',volume_size=None,volume_type=None)] {{(pid=124219) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:52:37.624391 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-113468b2-03e6-44b3-be97-77f17ab36132 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.737618 Jun 15 14:52:37.625222 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 559/1089] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 14:52:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:52:37.632670 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=2 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:37.634125 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:37.638702 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6571fe1b-517d-45c8-b0e0-4a1aef7979d4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:37.640368 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6571fe1b-517d-45c8-b0e0-4a1aef7979d4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:37.696207 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6571fe1b-517d-45c8-b0e0-4a1aef7979d4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:37.703374 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-6571fe1b-517d-45c8-b0e0-4a1aef7979d4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea" status: 200 len: 1095 microversion: 2.1 time: 0.072250 Jun 15 14:52:37.703938 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 531/1090] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:37 2022] GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:38.721178 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-69e484bf-87bf-4374-9f86-35840b4a3c49 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:38.721989 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-69e484bf-87bf-4374-9f86-35840b4a3c49 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:38.728551 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-69e484bf-87bf-4374-9f86-35840b4a3c49 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:38.729001 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-69e484bf-87bf-4374-9f86-35840b4a3c49 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:38.730084 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-69e484bf-87bf-4374-9f86-35840b4a3c49 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:38.730503 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-69e484bf-87bf-4374-9f86-35840b4a3c49 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:38.795278 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-69e484bf-87bf-4374-9f86-35840b4a3c49 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:38.803384 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-69e484bf-87bf-4374-9f86-35840b4a3c49 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea" status: 200 len: 1201 microversion: 2.1 time: 0.087177 Jun 15 14:52:38.804254 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 560/1091] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:38 2022] GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea => generated 1201 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:39.825793 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a97e8122-61f2-4a9e-ae9b-eae5faff1476 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:39.827214 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a97e8122-61f2-4a9e-ae9b-eae5faff1476 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:39.836188 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a97e8122-61f2-4a9e-ae9b-eae5faff1476 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:39.836773 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a97e8122-61f2-4a9e-ae9b-eae5faff1476 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:39.838101 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a97e8122-61f2-4a9e-ae9b-eae5faff1476 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:39.838695 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a97e8122-61f2-4a9e-ae9b-eae5faff1476 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:40.116103 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a97e8122-61f2-4a9e-ae9b-eae5faff1476 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:40.127494 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a97e8122-61f2-4a9e-ae9b-eae5faff1476 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea" status: 200 len: 1266 microversion: 2.1 time: 0.306855 Jun 15 14:52:40.128646 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 532/1092] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:39 2022] GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:40.552051 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-eb635c8b-4ce7-45ab-836a-0e0612f6e23c req-31188469-7032-41bf-959c-14d082f4f6db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10953e11-9e61-4fc0-8510-b8148a57dbea", "tag": "284def59-b3d2-48aa-878f-a16bd6b88750"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:52:40.580328 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-eb635c8b-4ce7-45ab-836a-0e0612f6e23c req-31188469-7032-41bf-959c-14d082f4f6db service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:40.581429 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-eb635c8b-4ce7-45ab-836a-0e0612f6e23c req-31188469-7032-41bf-959c-14d082f4f6db service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:40.598569 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-eb635c8b-4ce7-45ab-836a-0e0612f6e23c req-31188469-7032-41bf-959c-14d082f4f6db service nova] Creating event network-changed:284def59-b3d2-48aa-878f-a16bd6b88750 for instance 10953e11-9e61-4fc0-8510-b8148a57dbea on hv-cinder-84327 Jun 15 14:52:40.605385 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-eb635c8b-4ce7-45ab-836a-0e0612f6e23c req-31188469-7032-41bf-959c-14d082f4f6db service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058369 Jun 15 14:52:40.606844 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 561/1093] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:52:41.148067 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-aeb05064-9f71-4a57-b413-f21276d8a837 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:41.148855 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-aeb05064-9f71-4a57-b413-f21276d8a837 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:41.155906 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-aeb05064-9f71-4a57-b413-f21276d8a837 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:41.156350 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-aeb05064-9f71-4a57-b413-f21276d8a837 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:41.157315 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-aeb05064-9f71-4a57-b413-f21276d8a837 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:41.157944 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-aeb05064-9f71-4a57-b413-f21276d8a837 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:41.375807 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-aeb05064-9f71-4a57-b413-f21276d8a837 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:41.383732 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-aeb05064-9f71-4a57-b413-f21276d8a837 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea" status: 200 len: 1266 microversion: 2.1 time: 0.239980 Jun 15 14:52:41.384959 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 533/1094] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:41 2022] GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:42.404081 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-a4d3c7cc-d61e-4968-b9a0-a5bb861150d6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:42.404829 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-a4d3c7cc-d61e-4968-b9a0-a5bb861150d6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:42.412660 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a4d3c7cc-d61e-4968-b9a0-a5bb861150d6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:42.413114 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a4d3c7cc-d61e-4968-b9a0-a5bb861150d6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:42.414184 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a4d3c7cc-d61e-4968-b9a0-a5bb861150d6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:42.414629 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a4d3c7cc-d61e-4968-b9a0-a5bb861150d6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:42.554396 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-a4d3c7cc-d61e-4968-b9a0-a5bb861150d6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:42.561972 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-a4d3c7cc-d61e-4968-b9a0-a5bb861150d6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea" status: 200 len: 1266 microversion: 2.1 time: 0.163851 Jun 15 14:52:42.562540 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 562/1095] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:42 2022] GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:43.579641 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-54ef8e89-0063-4930-962e-b49966851f65 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:43.580265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-54ef8e89-0063-4930-962e-b49966851f65 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:43.587074 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-54ef8e89-0063-4930-962e-b49966851f65 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:43.587515 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-54ef8e89-0063-4930-962e-b49966851f65 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:43.588279 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-54ef8e89-0063-4930-962e-b49966851f65 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:43.588712 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-54ef8e89-0063-4930-962e-b49966851f65 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:43.721044 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-54ef8e89-0063-4930-962e-b49966851f65 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:43.728512 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-54ef8e89-0063-4930-962e-b49966851f65 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea" status: 200 len: 1266 microversion: 2.1 time: 0.153924 Jun 15 14:52:43.729075 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 534/1096] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:43 2022] GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:44.746517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-084d52e8-84b8-4626-b2ff-32e3aa8246f1 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:44.747049 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-084d52e8-84b8-4626-b2ff-32e3aa8246f1 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:44.754349 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-084d52e8-84b8-4626-b2ff-32e3aa8246f1 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:44.754799 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-084d52e8-84b8-4626-b2ff-32e3aa8246f1 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:44.755565 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-084d52e8-84b8-4626-b2ff-32e3aa8246f1 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:44.756006 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-084d52e8-84b8-4626-b2ff-32e3aa8246f1 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:44.888035 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-084d52e8-84b8-4626-b2ff-32e3aa8246f1 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:44.895691 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-084d52e8-84b8-4626-b2ff-32e3aa8246f1 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea" status: 200 len: 1266 microversion: 2.1 time: 0.153167 Jun 15 14:52:44.896253 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 563/1097] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:44 2022] GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:45.912333 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-7f8711fe-b5d9-4ada-9b70-47bd434dac7b tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:45.912948 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-7f8711fe-b5d9-4ada-9b70-47bd434dac7b tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:45.919385 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7f8711fe-b5d9-4ada-9b70-47bd434dac7b tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:45.919835 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7f8711fe-b5d9-4ada-9b70-47bd434dac7b tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:45.920600 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7f8711fe-b5d9-4ada-9b70-47bd434dac7b tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:45.921042 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7f8711fe-b5d9-4ada-9b70-47bd434dac7b tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:46.056098 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-7f8711fe-b5d9-4ada-9b70-47bd434dac7b tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:46.064134 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-7f8711fe-b5d9-4ada-9b70-47bd434dac7b tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea" status: 200 len: 1266 microversion: 2.1 time: 0.155722 Jun 15 14:52:46.064703 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 535/1098] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:45 2022] GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:47.081276 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3b8058ae-0ca3-49b2-839e-541774b8d1cf tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:47.081918 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-3b8058ae-0ca3-49b2-839e-541774b8d1cf tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:47.088650 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3b8058ae-0ca3-49b2-839e-541774b8d1cf tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:47.089105 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3b8058ae-0ca3-49b2-839e-541774b8d1cf tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:47.089908 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3b8058ae-0ca3-49b2-839e-541774b8d1cf tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:47.090350 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3b8058ae-0ca3-49b2-839e-541774b8d1cf tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:47.224678 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-3b8058ae-0ca3-49b2-839e-541774b8d1cf tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:47.232866 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-3b8058ae-0ca3-49b2-839e-541774b8d1cf tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea" status: 200 len: 1266 microversion: 2.1 time: 0.155905 Jun 15 14:52:47.233631 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 564/1099] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:47 2022] GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:48.249818 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-59113e6e-2296-4170-9d19-3b7742279959 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:48.250358 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-59113e6e-2296-4170-9d19-3b7742279959 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:48.252789 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=2 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:48.258283 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-59113e6e-2296-4170-9d19-3b7742279959 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:48.258735 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-59113e6e-2296-4170-9d19-3b7742279959 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:48.259493 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-59113e6e-2296-4170-9d19-3b7742279959 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:48.259932 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-59113e6e-2296-4170-9d19-3b7742279959 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:48.389877 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-59113e6e-2296-4170-9d19-3b7742279959 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:48.399418 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-59113e6e-2296-4170-9d19-3b7742279959 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea" status: 200 len: 1266 microversion: 2.1 time: 0.153369 Jun 15 14:52:48.400127 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 536/1100] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:48 2022] GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:49.416236 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-831ebc14-6e75-4bbf-9faa-f7f91956efdf tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:49.416851 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-831ebc14-6e75-4bbf-9faa-f7f91956efdf tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:49.418832 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=2 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:49.419499 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=6 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:49.426947 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-831ebc14-6e75-4bbf-9faa-f7f91956efdf tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:49.427413 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-831ebc14-6e75-4bbf-9faa-f7f91956efdf tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:49.428190 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-831ebc14-6e75-4bbf-9faa-f7f91956efdf tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:49.428632 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-831ebc14-6e75-4bbf-9faa-f7f91956efdf tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:49.556826 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-831ebc14-6e75-4bbf-9faa-f7f91956efdf tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:49.564464 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-831ebc14-6e75-4bbf-9faa-f7f91956efdf tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea" status: 200 len: 1266 microversion: 2.1 time: 0.152061 Jun 15 14:52:49.565018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 565/1101] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:49 2022] GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:50.582613 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-e8a8dfa5-78d0-483b-925e-04ac73ebee9d tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:50.583231 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-e8a8dfa5-78d0-483b-925e-04ac73ebee9d tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:50.589796 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e8a8dfa5-78d0-483b-925e-04ac73ebee9d tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:50.590259 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e8a8dfa5-78d0-483b-925e-04ac73ebee9d tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:50.591022 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e8a8dfa5-78d0-483b-925e-04ac73ebee9d tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:50.591519 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e8a8dfa5-78d0-483b-925e-04ac73ebee9d tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:50.722269 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e8a8dfa5-78d0-483b-925e-04ac73ebee9d tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:50.729874 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-e8a8dfa5-78d0-483b-925e-04ac73ebee9d tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea" status: 200 len: 1266 microversion: 2.1 time: 0.152082 Jun 15 14:52:50.730713 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 537/1102] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:50 2022] GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:51.746938 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-a00af2b3-9c0f-448b-b711-38831ea4eda6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:51.747615 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-a00af2b3-9c0f-448b-b711-38831ea4eda6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:51.754825 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a00af2b3-9c0f-448b-b711-38831ea4eda6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:51.755287 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a00af2b3-9c0f-448b-b711-38831ea4eda6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:51.756159 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a00af2b3-9c0f-448b-b711-38831ea4eda6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:51.756501 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a00af2b3-9c0f-448b-b711-38831ea4eda6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:51.893246 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-a00af2b3-9c0f-448b-b711-38831ea4eda6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:51.901504 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-a00af2b3-9c0f-448b-b711-38831ea4eda6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea" status: 200 len: 1266 microversion: 2.1 time: 0.158376 Jun 15 14:52:51.902108 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 566/1103] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:51 2022] GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:52.918946 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-8464dc91-e2b0-488b-9056-9516d8a047a5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:52.919546 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-8464dc91-e2b0-488b-9056-9516d8a047a5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:52.926537 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8464dc91-e2b0-488b-9056-9516d8a047a5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:52.926984 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8464dc91-e2b0-488b-9056-9516d8a047a5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:52.927739 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8464dc91-e2b0-488b-9056-9516d8a047a5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:52.928190 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8464dc91-e2b0-488b-9056-9516d8a047a5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:53.062354 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-8464dc91-e2b0-488b-9056-9516d8a047a5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:53.069757 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-8464dc91-e2b0-488b-9056-9516d8a047a5 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea" status: 200 len: 1266 microversion: 2.1 time: 0.154689 Jun 15 14:52:53.070331 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 538/1104] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:52 2022] GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:54.088128 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3f4b40d0-64b2-49cb-839e-d8f0e4bd7d1c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:54.088658 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-3f4b40d0-64b2-49cb-839e-d8f0e4bd7d1c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:54.095168 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3f4b40d0-64b2-49cb-839e-d8f0e4bd7d1c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:54.095682 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3f4b40d0-64b2-49cb-839e-d8f0e4bd7d1c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:54.096381 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3f4b40d0-64b2-49cb-839e-d8f0e4bd7d1c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:54.096820 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3f4b40d0-64b2-49cb-839e-d8f0e4bd7d1c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:54.229636 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-3f4b40d0-64b2-49cb-839e-d8f0e4bd7d1c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:54.237365 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-3f4b40d0-64b2-49cb-839e-d8f0e4bd7d1c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea" status: 200 len: 1266 microversion: 2.1 time: 0.153194 Jun 15 14:52:54.237964 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 567/1105] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:54 2022] GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:55.253720 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c673ef0c-d406-4737-b38c-602d87404617 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:55.254265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-c673ef0c-d406-4737-b38c-602d87404617 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:55.260376 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c673ef0c-d406-4737-b38c-602d87404617 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:55.260839 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c673ef0c-d406-4737-b38c-602d87404617 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:55.261711 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c673ef0c-d406-4737-b38c-602d87404617 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:55.262155 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c673ef0c-d406-4737-b38c-602d87404617 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:55.391036 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-c673ef0c-d406-4737-b38c-602d87404617 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:55.399272 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-c673ef0c-d406-4737-b38c-602d87404617 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea" status: 200 len: 1266 microversion: 2.1 time: 0.149695 Jun 15 14:52:55.399837 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 539/1106] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:55 2022] GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:56.036804 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-8e7bc81b-9b8d-48ac-a6da-58cf97646046 req-c34b7392-30a3-4d03-8e5f-1c7083df17c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10953e11-9e61-4fc0-8510-b8148a57dbea", "name": "network-vif-plugged", "status": "completed", "tag": "284def59-b3d2-48aa-878f-a16bd6b88750"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:52:56.045838 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-8e7bc81b-9b8d-48ac-a6da-58cf97646046 req-c34b7392-30a3-4d03-8e5f-1c7083df17c3 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:56.046502 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-8e7bc81b-9b8d-48ac-a6da-58cf97646046 req-c34b7392-30a3-4d03-8e5f-1c7083df17c3 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:56.058415 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-8e7bc81b-9b8d-48ac-a6da-58cf97646046 req-c34b7392-30a3-4d03-8e5f-1c7083df17c3 service nova] Creating event network-vif-plugged:284def59-b3d2-48aa-878f-a16bd6b88750 for instance 10953e11-9e61-4fc0-8510-b8148a57dbea on hv-cinder-84327 Jun 15 14:52:56.063599 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-8e7bc81b-9b8d-48ac-a6da-58cf97646046 req-c34b7392-30a3-4d03-8e5f-1c7083df17c3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030530 Jun 15 14:52:56.064406 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 568/1107] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:52:56.416410 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c5032b09-2eb7-4a32-a5fb-ad2faf35ae0c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:56.417109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-c5032b09-2eb7-4a32-a5fb-ad2faf35ae0c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:56.423819 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c5032b09-2eb7-4a32-a5fb-ad2faf35ae0c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:56.424271 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c5032b09-2eb7-4a32-a5fb-ad2faf35ae0c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:56.425040 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c5032b09-2eb7-4a32-a5fb-ad2faf35ae0c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:56.425485 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c5032b09-2eb7-4a32-a5fb-ad2faf35ae0c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:56.573418 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-c5032b09-2eb7-4a32-a5fb-ad2faf35ae0c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:56.580897 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-c5032b09-2eb7-4a32-a5fb-ad2faf35ae0c tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea" status: 200 len: 1266 microversion: 2.1 time: 0.168416 Jun 15 14:52:56.581501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 540/1108] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:56 2022] GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:57.599180 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-19d020f5-1a00-4f51-8be3-55d670d449e4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:57.600340 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-19d020f5-1a00-4f51-8be3-55d670d449e4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:57.607580 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-19d020f5-1a00-4f51-8be3-55d670d449e4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:57.608022 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-19d020f5-1a00-4f51-8be3-55d670d449e4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:57.608860 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-19d020f5-1a00-4f51-8be3-55d670d449e4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:57.609294 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-19d020f5-1a00-4f51-8be3-55d670d449e4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:57.750276 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-19d020f5-1a00-4f51-8be3-55d670d449e4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:57.757795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-19d020f5-1a00-4f51-8be3-55d670d449e4 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea" status: 200 len: 1266 microversion: 2.1 time: 0.163050 Jun 15 14:52:57.758920 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 569/1109] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:57 2022] GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:58.775225 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-212f142e-595d-448c-bd08-b08decf4ed47 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:58.775772 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-212f142e-595d-448c-bd08-b08decf4ed47 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:58.782518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-212f142e-595d-448c-bd08-b08decf4ed47 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:58.782970 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-212f142e-595d-448c-bd08-b08decf4ed47 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:58.783738 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-212f142e-595d-448c-bd08-b08decf4ed47 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:58.784180 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-212f142e-595d-448c-bd08-b08decf4ed47 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:58.923208 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-212f142e-595d-448c-bd08-b08decf4ed47 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:58.930929 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-212f142e-595d-448c-bd08-b08decf4ed47 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea" status: 200 len: 1453 microversion: 2.1 time: 0.160372 Jun 15 14:52:58.931501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 541/1110] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:58 2022] GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:58.948039 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-130c99c2-5a4a-4fbf-aecb-b80d46a75df9 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:58.949600 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-130c99c2-5a4a-4fbf-aecb-b80d46a75df9 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:58.957730 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-130c99c2-5a4a-4fbf-aecb-b80d46a75df9 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:58.958689 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-130c99c2-5a4a-4fbf-aecb-b80d46a75df9 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:58.959990 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-130c99c2-5a4a-4fbf-aecb-b80d46a75df9 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:58.960422 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-130c99c2-5a4a-4fbf-aecb-b80d46a75df9 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:59.096870 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-130c99c2-5a4a-4fbf-aecb-b80d46a75df9 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:59.105144 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-130c99c2-5a4a-4fbf-aecb-b80d46a75df9 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea" status: 200 len: 1453 microversion: 2.1 time: 0.162039 Jun 15 14:52:59.106003 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 570/1111] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:58 2022] GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:01.292207 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-8d6ea356-dc65-4f6a-a80c-f9ae55a0bff9 req-0183122d-6011-4445-9ae8-a1c86d33fecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10953e11-9e61-4fc0-8510-b8148a57dbea", "tag": "284def59-b3d2-48aa-878f-a16bd6b88750"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:53:01.302844 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-8d6ea356-dc65-4f6a-a80c-f9ae55a0bff9 req-0183122d-6011-4445-9ae8-a1c86d33fecc service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:01.304307 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-8d6ea356-dc65-4f6a-a80c-f9ae55a0bff9 req-0183122d-6011-4445-9ae8-a1c86d33fecc service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:01.324948 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-8d6ea356-dc65-4f6a-a80c-f9ae55a0bff9 req-0183122d-6011-4445-9ae8-a1c86d33fecc service nova] Creating event network-changed:284def59-b3d2-48aa-878f-a16bd6b88750 for instance 10953e11-9e61-4fc0-8510-b8148a57dbea on hv-cinder-84327 Jun 15 14:53:01.331165 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-8d6ea356-dc65-4f6a-a80c-f9ae55a0bff9 req-0183122d-6011-4445-9ae8-a1c86d33fecc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043824 Jun 15 14:53:01.332205 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 542/1112] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:53:16.094653 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-32a62281-6d76-407f-855c-88302b1aff4f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:16.095181 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-32a62281-6d76-407f-855c-88302b1aff4f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:16.097609 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:16.098409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=60 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:16.104472 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-32a62281-6d76-407f-855c-88302b1aff4f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:16.104924 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-32a62281-6d76-407f-855c-88302b1aff4f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:16.105721 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-32a62281-6d76-407f-855c-88302b1aff4f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:16.106426 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-32a62281-6d76-407f-855c-88302b1aff4f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:16.130303 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-32a62281-6d76-407f-855c-88302b1aff4f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f/ips" status: 200 len: 149 microversion: 2.1 time: 0.039872 Jun 15 14:53:16.130860 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 571/1113] 10.222.0.57 () {58 vars in 1247 bytes} [Wed Jun 15 14:53:16 2022] GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:53:16.139557 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=26 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:16.140417 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=62 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:16.144565 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-7e2f7308-d7ea-42fd-8b9d-35d8e055d86f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5aab045c-5fdd-4b4a-8ac9-8e44a6531ac7"}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:53:16.145716 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-7e2f7308-d7ea-42fd-8b9d-35d8e055d86f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:16.153168 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7e2f7308-d7ea-42fd-8b9d-35d8e055d86f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:16.153612 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7e2f7308-d7ea-42fd-8b9d-35d8e055d86f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:16.154393 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7e2f7308-d7ea-42fd-8b9d-35d8e055d86f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:16.154823 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7e2f7308-d7ea-42fd-8b9d-35d8e055d86f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:16.400428 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.wsgi [None req-7e2f7308-d7ea-42fd-8b9d-35d8e055d86f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] HTTP exception thrown: Invalid volume: volume 5aab045c-5fdd-4b4a-8ac9-8e44a6531ac7 is already attached to instances: a97884f7-868c-4b2a-b518-feac560b9eff Jun 15 14:53:16.402361 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-7e2f7308-d7ea-42fd-8b9d-35d8e055d86f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Request method failure captured: Jun 15 14:53:16.402361 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: request: POST /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f/os-volume_attachments HTTP/1.1 Jun 15 14:53:16.402361 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept: application/json Jun 15 14:53:16.402361 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept-Encoding: identity Jun 15 14:53:16.402361 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Connection: close Jun 15 14:53:16.402361 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Length: 74 Jun 15 14:53:16.402361 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Type: application/json Jun 15 14:53:16.402361 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Host: 10.222.0.57 Jun 15 14:53:16.402361 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Openstack-System-Scope: None Jun 15 14:53:16.402361 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: User-Agent: python-urllib3/1.26.9 Jun 15 14:53:16.402361 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Auth-Token: gAAAAABiqfGtA81J1G_x2ff3wIk9WNt3QYmnBm26jR3C1Gs2is-P7wpJkQsDSBdU7d-N9JTLRxl70QNiPGwIBDR5YY-rvbFUD77VY73Ns036wSG64JihGQQVBXgVpi8TCxZ4jrtMxLvpDXwplGMkMYm1p0WTNbEoOI9C6x7l5c7PYtxIYCxejUU Jun 15 14:53:16.402361 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Id: None Jun 15 14:53:16.402361 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Name: None Jun 15 14:53:16.402361 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Identity-Status: Confirmed Jun 15 14:53:16.402361 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Is-Admin-Project: True Jun 15 14:53:16.402361 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Id: default Jun 15 14:53:16.402361 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Name: Default Jun 15 14:53:16.402361 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:53:16.402361 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:53:16.402361 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Role: member,reader Jun 15 14:53:16.402361 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Roles: member,reader Jun 15 14:53:16.404051 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_591d111357224477998b265d45e3ee0d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/591d111357224477998b265d45e3ee0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:53:16.404051 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:53:16.404051 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:53:16.404051 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:53:16.404051 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:53:16.404051 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Id: default Jun 15 14:53:16.404051 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Name: Default Jun 15 14:53:16.404051 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Id: 6caa64aecb914e968d057b6b593f667f Jun 15 14:53:16.404051 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Name: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:53:16.404051 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Jun 15 14:53:16.404051 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {"volumeAttachment": {"volumeId": "5aab045c-5fdd-4b4a-8ac9-8e44a6531ac7"}} Jun 15 14:53:16.404051 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: method: > Jun 15 14:53:16.405009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: exception: Invalid volume: volume 5aab045c-5fdd-4b4a-8ac9-8e44a6531ac7 is already attached to instances: a97884f7-868c-4b2a-b518-feac560b9eff Jun 15 14:53:16.405009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: action_args: {'server_id': '3f35bd7e-d113-487b-9ed4-a312a5ee780f', 'body': {'volumeAttachment': {'volumeId': '5aab045c-5fdd-4b4a-8ac9-8e44a6531ac7'}}} Jun 15 14:53:16.405009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:53:16.405009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:53:16.405009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 14:53:16.405009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 14:53:16.405009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 14:53:16.405009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 14:53:16.405009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 14:53:16.405009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 14:53:16.405009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 15 14:53:16.405009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 15 14:53:16.405009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 15 14:53:16.405009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 15 14:53:16.405009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5aab045c-5fdd-4b4a-8ac9-8e44a6531ac7 is already attached to instances: a97884f7-868c-4b2a-b518-feac560b9eff Jun 15 14:53:16.405009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:53:16.405009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:53:16.405009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:53:16.405009 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:53:16.406501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:53:16.406501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:53:16.406501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:53:16.406501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:53:16.406501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:53:16.406501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:53:16.406501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 14:53:16.406501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:53:16.406501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 14:53:16.406501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:53:16.406501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 14:53:16.406501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:53:16.406501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 15 14:53:16.406501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 14:53:16.406501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5aab045c-5fdd-4b4a-8ac9-8e44a6531ac7 is already attached to instances: a97884f7-868c-4b2a-b518-feac560b9eff Jun 15 14:53:16.406501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:53:16.406501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:53:16.406501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:53:16.406501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:53:16.406501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:53:16.408079 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:53:16.408079 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:53:16.408079 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:53:16.408079 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5aab045c-5fdd-4b4a-8ac9-8e44a6531ac7 is already attached to instances: a97884f7-868c-4b2a-b518-feac560b9eff Jun 15 14:53:16.408079 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:53:16.408079 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-7e2f7308-d7ea-42fd-8b9d-35d8e055d86f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Returning 400 to user: Invalid volume: volume 5aab045c-5fdd-4b4a-8ac9-8e44a6531ac7 is already attached to instances: a97884f7-868c-4b2a-b518-feac560b9eff {{(pid=124220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:53:16.408079 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-7e2f7308-d7ea-42fd-8b9d-35d8e055d86f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "POST /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.265779 Jun 15 14:53:16.408079 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 543/1114] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 14:53:16 2022] POST /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f/os-volume_attachments => generated 174 bytes in 267 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 15 14:53:16.412424 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-fb6f8a2c-23a5-493e-abdb-7e9dfcee5b04 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:16.412929 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-fb6f8a2c-23a5-493e-abdb-7e9dfcee5b04 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:16.419575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fb6f8a2c-23a5-493e-abdb-7e9dfcee5b04 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:16.420022 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fb6f8a2c-23a5-493e-abdb-7e9dfcee5b04 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:16.420776 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fb6f8a2c-23a5-493e-abdb-7e9dfcee5b04 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:16.421212 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fb6f8a2c-23a5-493e-abdb-7e9dfcee5b04 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:16.448471 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-fb6f8a2c-23a5-493e-abdb-7e9dfcee5b04 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Going to try to terminate instance {{(pid=124219) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:53:16.530045 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-fb6f8a2c-23a5-493e-abdb-7e9dfcee5b04 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f" status: 204 len: 0 microversion: 2.1 time: 0.121141 Jun 15 14:53:16.530656 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 572/1115] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:53:16 2022] DELETE /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:53:16.539412 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a1f97782-342b-4b31-9631-3f00d7c5facf tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:16.541908 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a1f97782-342b-4b31-9631-3f00d7c5facf tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:16.549550 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a1f97782-342b-4b31-9631-3f00d7c5facf tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:16.550104 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a1f97782-342b-4b31-9631-3f00d7c5facf tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:16.550955 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a1f97782-342b-4b31-9631-3f00d7c5facf tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:16.551397 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a1f97782-342b-4b31-9631-3f00d7c5facf tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:16.682402 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a1f97782-342b-4b31-9631-3f00d7c5facf tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:16.690058 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a1f97782-342b-4b31-9631-3f00d7c5facf tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f" status: 200 len: 1682 microversion: 2.1 time: 0.155187 Jun 15 14:53:16.690614 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 544/1116] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:16 2022] GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:53:17.708038 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-9732d7d0-0daa-448c-86a1-c94e04ee700c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:17.708658 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-9732d7d0-0daa-448c-86a1-c94e04ee700c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:17.715405 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9732d7d0-0daa-448c-86a1-c94e04ee700c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:17.715872 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9732d7d0-0daa-448c-86a1-c94e04ee700c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:17.716640 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9732d7d0-0daa-448c-86a1-c94e04ee700c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:17.717075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9732d7d0-0daa-448c-86a1-c94e04ee700c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:17.955861 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-9732d7d0-0daa-448c-86a1-c94e04ee700c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:17.964237 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-9732d7d0-0daa-448c-86a1-c94e04ee700c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f" status: 200 len: 1682 microversion: 2.1 time: 0.260530 Jun 15 14:53:17.964726 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 573/1117] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:17 2022] GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f => generated 1682 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:18.981417 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-4ea2c688-c4db-4468-8dd8-8b125d782113 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:18.982080 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-4ea2c688-c4db-4468-8dd8-8b125d782113 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:18.989108 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4ea2c688-c4db-4468-8dd8-8b125d782113 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:18.989559 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4ea2c688-c4db-4468-8dd8-8b125d782113 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:18.990375 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4ea2c688-c4db-4468-8dd8-8b125d782113 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:18.990834 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4ea2c688-c4db-4468-8dd8-8b125d782113 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:19.244818 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-4ea2c688-c4db-4468-8dd8-8b125d782113 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:19.252676 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-4ea2c688-c4db-4468-8dd8-8b125d782113 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f" status: 200 len: 1682 microversion: 2.1 time: 0.275396 Jun 15 14:53:19.253242 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 545/1118] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:18 2022] GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f => generated 1682 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:19.878079 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-697ae0bc-b65b-4c18-a2db-1e817aac65cc req-b9b2ae1b-bcfb-47bb-bf54-d877c91b360a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f35bd7e-d113-487b-9ed4-a312a5ee780f", "name": "network-vif-deleted", "tag": "b6827f41-b0d7-4e45-994a-b8439850ce16"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:53:19.887059 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-697ae0bc-b65b-4c18-a2db-1e817aac65cc req-b9b2ae1b-bcfb-47bb-bf54-d877c91b360a service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:19.887544 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-697ae0bc-b65b-4c18-a2db-1e817aac65cc req-b9b2ae1b-bcfb-47bb-bf54-d877c91b360a service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:19.898916 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-697ae0bc-b65b-4c18-a2db-1e817aac65cc req-b9b2ae1b-bcfb-47bb-bf54-d877c91b360a service nova] Creating event network-vif-deleted:b6827f41-b0d7-4e45-994a-b8439850ce16 for instance 3f35bd7e-d113-487b-9ed4-a312a5ee780f on hv-cinder-84327 Jun 15 14:53:19.905692 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-697ae0bc-b65b-4c18-a2db-1e817aac65cc req-b9b2ae1b-bcfb-47bb-bf54-d877c91b360a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030692 Jun 15 14:53:19.905692 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 574/1119] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:53:20.269865 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-84053f84-6d2c-4b93-99cf-d7f3edb8489a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:20.270518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-84053f84-6d2c-4b93-99cf-d7f3edb8489a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:20.277930 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-84053f84-6d2c-4b93-99cf-d7f3edb8489a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:20.278397 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-84053f84-6d2c-4b93-99cf-d7f3edb8489a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:20.279211 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-84053f84-6d2c-4b93-99cf-d7f3edb8489a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:20.279655 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-84053f84-6d2c-4b93-99cf-d7f3edb8489a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:20.313967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-84053f84-6d2c-4b93-99cf-d7f3edb8489a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:20.314414 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-84053f84-6d2c-4b93-99cf-d7f3edb8489a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:20.314871 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.objects.instance [None req-84053f84-6d2c-4b93-99cf-d7f3edb8489a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lazy-loading 'fault' on Instance uuid 3f35bd7e-d113-487b-9ed4-a312a5ee780f {{(pid=124220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:53:20.358822 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-84053f84-6d2c-4b93-99cf-d7f3edb8489a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:20.366709 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-84053f84-6d2c-4b93-99cf-d7f3edb8489a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f" status: 200 len: 1332 microversion: 2.1 time: 0.100897 Jun 15 14:53:20.367313 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 546/1120] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:20 2022] GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:21.384831 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-5fb368b0-d542-4710-be80-2c4dc6deeb12 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:21.385532 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-5fb368b0-d542-4710-be80-2c4dc6deeb12 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:21.391981 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5fb368b0-d542-4710-be80-2c4dc6deeb12 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:21.392432 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5fb368b0-d542-4710-be80-2c4dc6deeb12 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:21.393195 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5fb368b0-d542-4710-be80-2c4dc6deeb12 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:21.393726 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5fb368b0-d542-4710-be80-2c4dc6deeb12 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:21.408984 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-5fb368b0-d542-4710-be80-2c4dc6deeb12 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] HTTP exception thrown: Instance 3f35bd7e-d113-487b-9ed4-a312a5ee780f could not be found. Jun 15 14:53:21.411700 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-5fb368b0-d542-4710-be80-2c4dc6deeb12 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Request method failure captured: Jun 15 14:53:21.411700 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f HTTP/1.1 Jun 15 14:53:21.411700 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:53:21.411700 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:53:21.411700 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:53:21.411700 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:53:21.411700 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:53:21.411700 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:53:21.411700 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:53:21.411700 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:53:21.411700 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfGtA81J1G_x2ff3wIk9WNt3QYmnBm26jR3C1Gs2is-P7wpJkQsDSBdU7d-N9JTLRxl70QNiPGwIBDR5YY-rvbFUD77VY73Ns036wSG64JihGQQVBXgVpi8TCxZ4jrtMxLvpDXwplGMkMYm1p0WTNbEoOI9C6x7l5c7PYtxIYCxejUU Jun 15 14:53:21.411700 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:53:21.411700 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:53:21.411700 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:53:21.411700 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:53:21.411700 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:53:21.411700 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:53:21.411700 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:53:21.411700 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:53:21.411700 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:53:21.411700 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:53:21.413257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_591d111357224477998b265d45e3ee0d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/591d111357224477998b265d45e3ee0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:53:21.413257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:53:21.413257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:53:21.413257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:53:21.413257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:53:21.413257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:53:21.413257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:53:21.413257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 6caa64aecb914e968d057b6b593f667f Jun 15 14:53:21.413257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:53:21.413257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:53:21.413257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Instance 3f35bd7e-d113-487b-9ed4-a312a5ee780f could not be found. Jun 15 14:53:21.413257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': '3f35bd7e-d113-487b-9ed4-a312a5ee780f'} Jun 15 14:53:21.414232 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:53:21.414232 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:53:21.414232 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:53:21.414232 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:53:21.414232 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:53:21.414232 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:53:21.414232 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:53:21.414232 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:53:21.414232 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:53:21.414232 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:53:21.414232 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f35bd7e-d113-487b-9ed4-a312a5ee780f could not be found. Jun 15 14:53:21.414232 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:53:21.414232 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:53:21.414232 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:53:21.414232 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:53:21.414232 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:53:21.414232 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:53:21.414232 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:53:21.414232 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:53:21.414232 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:53:21.415934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:53:21.415934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:53:21.415934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:53:21.415934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:53:21.415934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:53:21.415934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:53:21.415934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:53:21.415934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f35bd7e-d113-487b-9ed4-a312a5ee780f could not be found. Jun 15 14:53:21.415934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:53:21.415934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:53:21.415934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:53:21.415934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:53:21.415934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:53:21.415934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:53:21.415934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:53:21.415934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:53:21.415934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f35bd7e-d113-487b-9ed4-a312a5ee780f could not be found. Jun 15 14:53:21.415934 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:53:21.417323 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-5fb368b0-d542-4710-be80-2c4dc6deeb12 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Returning 404 to user: Instance 3f35bd7e-d113-487b-9ed4-a312a5ee780f could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:53:21.417323 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-5fb368b0-d542-4710-be80-2c4dc6deeb12 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f" status: 404 len: 111 microversion: 2.1 time: 0.033452 Jun 15 14:53:21.417323 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 575/1121] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:21 2022] GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:53:21.424762 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-563ae269-d53c-4b52-86dc-b9b38b976fc2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '.version_select at 0x7f8f13732a60>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:21.443077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-563ae269-d53c-4b52-86dc-b9b38b976fc2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1331277290" status: 202 len: 0 microversion: 2.1 time: 0.022019 Jun 15 14:53:21.443655 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 547/1122] 10.222.0.57 () {58 vars in 1220 bytes} [Wed Jun 15 14:53:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1331277290 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:53:22.112141 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-09aa2a0a-2787-4b4b-a056-55fd073881b2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:22.112640 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-09aa2a0a-2787-4b4b-a056-55fd073881b2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:22.118603 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-09aa2a0a-2787-4b4b-a056-55fd073881b2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:22.119055 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-09aa2a0a-2787-4b4b-a056-55fd073881b2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:22.119817 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-09aa2a0a-2787-4b4b-a056-55fd073881b2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:22.120256 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-09aa2a0a-2787-4b4b-a056-55fd073881b2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:22.201427 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.objects.instance [None req-09aa2a0a-2787-4b4b-a056-55fd073881b2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lazy-loading 'services' on Instance uuid a97884f7-868c-4b2a-b518-feac560b9eff {{(pid=124219) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:53:22.273015 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-09aa2a0a-2787-4b4b-a056-55fd073881b2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff/os-volume_attachments/5aab045c-5fdd-4b4a-8ac9-8e44a6531ac7" status: 202 len: 0 microversion: 2.1 time: 0.164506 Jun 15 14:53:22.273598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 576/1123] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Jun 15 14:53:22 2022] DELETE /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff/os-volume_attachments/5aab045c-5fdd-4b4a-8ac9-8e44a6531ac7 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:53:22.282226 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-b1ad79b9-9a14-412e-8897-01a15043e8d1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:22.283264 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-b1ad79b9-9a14-412e-8897-01a15043e8d1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:22.291865 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b1ad79b9-9a14-412e-8897-01a15043e8d1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:22.292446 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b1ad79b9-9a14-412e-8897-01a15043e8d1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:22.293433 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b1ad79b9-9a14-412e-8897-01a15043e8d1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:22.294198 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b1ad79b9-9a14-412e-8897-01a15043e8d1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:22.333018 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-b1ad79b9-9a14-412e-8897-01a15043e8d1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054897 Jun 15 14:53:22.333590 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 548/1124] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 14:53:22 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:53:23.346509 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e49756fe-6396-4e99-b222-f0f8b91aeed4 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:23.347580 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-e49756fe-6396-4e99-b222-f0f8b91aeed4 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:23.354407 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e49756fe-6396-4e99-b222-f0f8b91aeed4 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:23.354861 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e49756fe-6396-4e99-b222-f0f8b91aeed4 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:23.355641 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e49756fe-6396-4e99-b222-f0f8b91aeed4 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:23.356298 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e49756fe-6396-4e99-b222-f0f8b91aeed4 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:23.388683 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-e49756fe-6396-4e99-b222-f0f8b91aeed4 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046669 Jun 15 14:53:23.389499 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 577/1125] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 14:53:23 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:53:24.400420 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-87f7172f-ab0f-419e-a5cc-3d09a2153fca tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:24.401336 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-87f7172f-ab0f-419e-a5cc-3d09a2153fca tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:24.408673 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-87f7172f-ab0f-419e-a5cc-3d09a2153fca tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:24.409119 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-87f7172f-ab0f-419e-a5cc-3d09a2153fca tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:24.409905 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-87f7172f-ab0f-419e-a5cc-3d09a2153fca tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:24.410341 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-87f7172f-ab0f-419e-a5cc-3d09a2153fca tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:24.440776 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-87f7172f-ab0f-419e-a5cc-3d09a2153fca tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044462 Jun 15 14:53:24.441527 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 549/1126] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 14:53:24 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 14:53:24.503189 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-a0caadbb-0998-419c-bc5c-85d8d80501b1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:24.503719 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-a0caadbb-0998-419c-bc5c-85d8d80501b1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:24.510184 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a0caadbb-0998-419c-bc5c-85d8d80501b1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:24.510638 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a0caadbb-0998-419c-bc5c-85d8d80501b1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:24.511395 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a0caadbb-0998-419c-bc5c-85d8d80501b1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:24.511839 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a0caadbb-0998-419c-bc5c-85d8d80501b1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:24.538623 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-a0caadbb-0998-419c-bc5c-85d8d80501b1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Going to try to terminate instance {{(pid=124219) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:53:24.616060 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-a0caadbb-0998-419c-bc5c-85d8d80501b1 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 204 len: 0 microversion: 2.1 time: 0.116365 Jun 15 14:53:24.616657 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 578/1127] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:53:24 2022] DELETE /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:53:24.624923 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-bf498f8e-fbb8-45fd-a526-3d875b73cc2c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:24.625997 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-bf498f8e-fbb8-45fd-a526-3d875b73cc2c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:24.632866 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-bf498f8e-fbb8-45fd-a526-3d875b73cc2c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:24.633394 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-bf498f8e-fbb8-45fd-a526-3d875b73cc2c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:24.634216 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-bf498f8e-fbb8-45fd-a526-3d875b73cc2c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:24.634662 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-bf498f8e-fbb8-45fd-a526-3d875b73cc2c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:24.769990 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-bf498f8e-fbb8-45fd-a526-3d875b73cc2c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:24.777859 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-bf498f8e-fbb8-45fd-a526-3d875b73cc2c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1683 microversion: 2.1 time: 0.156764 Jun 15 14:53:24.779237 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 550/1128] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:24 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:53:25.796061 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-1ceecc77-3a2e-4a99-ab92-9fa3e62a73e8 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:25.796761 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-1ceecc77-3a2e-4a99-ab92-9fa3e62a73e8 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:25.803411 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1ceecc77-3a2e-4a99-ab92-9fa3e62a73e8 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:25.803863 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1ceecc77-3a2e-4a99-ab92-9fa3e62a73e8 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:25.804636 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1ceecc77-3a2e-4a99-ab92-9fa3e62a73e8 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:25.805107 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1ceecc77-3a2e-4a99-ab92-9fa3e62a73e8 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:25.945357 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-1ceecc77-3a2e-4a99-ab92-9fa3e62a73e8 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:25.953567 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-1ceecc77-3a2e-4a99-ab92-9fa3e62a73e8 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1683 microversion: 2.1 time: 0.161780 Jun 15 14:53:25.954163 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 579/1129] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:25 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:26.971083 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-011623a8-b0fb-4a54-b964-c2f598cfa2e7 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:26.971712 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-011623a8-b0fb-4a54-b964-c2f598cfa2e7 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:26.978500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-011623a8-b0fb-4a54-b964-c2f598cfa2e7 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:26.978958 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-011623a8-b0fb-4a54-b964-c2f598cfa2e7 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:26.979726 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-011623a8-b0fb-4a54-b964-c2f598cfa2e7 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:26.980164 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-011623a8-b0fb-4a54-b964-c2f598cfa2e7 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:27.195181 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-011623a8-b0fb-4a54-b964-c2f598cfa2e7 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:27.203619 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-011623a8-b0fb-4a54-b964-c2f598cfa2e7 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1683 microversion: 2.1 time: 0.236398 Jun 15 14:53:27.204283 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 551/1130] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:26 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1683 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:27.883559 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-b27accc5-a014-4464-b594-bd886b491edd req-7823fbd9-21c5-4963-857f-f8e0c3939fcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97884f7-868c-4b2a-b518-feac560b9eff", "name": "network-vif-deleted", "tag": "147f701a-dd9f-4cee-8def-a74eb3f0c1fd"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:53:27.893047 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-b27accc5-a014-4464-b594-bd886b491edd req-7823fbd9-21c5-4963-857f-f8e0c3939fcb service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:27.893494 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-b27accc5-a014-4464-b594-bd886b491edd req-7823fbd9-21c5-4963-857f-f8e0c3939fcb service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:27.905160 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-b27accc5-a014-4464-b594-bd886b491edd req-7823fbd9-21c5-4963-857f-f8e0c3939fcb service nova] Creating event network-vif-deleted:147f701a-dd9f-4cee-8def-a74eb3f0c1fd for instance a97884f7-868c-4b2a-b518-feac560b9eff on hv-cinder-84327 Jun 15 14:53:27.910395 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-b27accc5-a014-4464-b594-bd886b491edd req-7823fbd9-21c5-4963-857f-f8e0c3939fcb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030419 Jun 15 14:53:27.914214 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 580/1131] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:53:28.221354 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-cb37dcfe-67a3-4e79-b90d-683e26be4372 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:28.222020 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-cb37dcfe-67a3-4e79-b90d-683e26be4372 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:28.228747 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cb37dcfe-67a3-4e79-b90d-683e26be4372 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:28.229339 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cb37dcfe-67a3-4e79-b90d-683e26be4372 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:28.230264 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cb37dcfe-67a3-4e79-b90d-683e26be4372 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:28.230744 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cb37dcfe-67a3-4e79-b90d-683e26be4372 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:28.263429 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cb37dcfe-67a3-4e79-b90d-683e26be4372 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:28.264568 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-cb37dcfe-67a3-4e79-b90d-683e26be4372 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:28.265019 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.objects.instance [None req-cb37dcfe-67a3-4e79-b90d-683e26be4372 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lazy-loading 'fault' on Instance uuid a97884f7-868c-4b2a-b518-feac560b9eff {{(pid=124220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:53:28.309362 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-cb37dcfe-67a3-4e79-b90d-683e26be4372 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:28.317909 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-cb37dcfe-67a3-4e79-b90d-683e26be4372 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 200 len: 1332 microversion: 2.1 time: 0.100495 Jun 15 14:53:28.318585 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 552/1132] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:28 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:29.336425 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e4a04b03-4f25-413a-9a6e-36bbba16a79f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:29.337157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-e4a04b03-4f25-413a-9a6e-36bbba16a79f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:29.344246 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e4a04b03-4f25-413a-9a6e-36bbba16a79f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:29.344701 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e4a04b03-4f25-413a-9a6e-36bbba16a79f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:29.345472 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e4a04b03-4f25-413a-9a6e-36bbba16a79f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:29.345946 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e4a04b03-4f25-413a-9a6e-36bbba16a79f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:29.359335 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-e4a04b03-4f25-413a-9a6e-36bbba16a79f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] HTTP exception thrown: Instance a97884f7-868c-4b2a-b518-feac560b9eff could not be found. Jun 15 14:53:29.361052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e4a04b03-4f25-413a-9a6e-36bbba16a79f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Request method failure captured: Jun 15 14:53:29.361052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff HTTP/1.1 Jun 15 14:53:29.361052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:53:29.361052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:53:29.361052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:53:29.361052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:53:29.361052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:53:29.361052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:53:29.361052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:53:29.361052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:53:29.361052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfGtA81J1G_x2ff3wIk9WNt3QYmnBm26jR3C1Gs2is-P7wpJkQsDSBdU7d-N9JTLRxl70QNiPGwIBDR5YY-rvbFUD77VY73Ns036wSG64JihGQQVBXgVpi8TCxZ4jrtMxLvpDXwplGMkMYm1p0WTNbEoOI9C6x7l5c7PYtxIYCxejUU Jun 15 14:53:29.361052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:53:29.361052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:53:29.361052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:53:29.361052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:53:29.361052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:53:29.361052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:53:29.361052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:53:29.361052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:53:29.361052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:53:29.361052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:53:29.362845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_591d111357224477998b265d45e3ee0d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/591d111357224477998b265d45e3ee0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:53:29.362845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:53:29.362845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:53:29.362845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:53:29.362845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:53:29.362845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:53:29.362845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:53:29.362845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 6caa64aecb914e968d057b6b593f667f Jun 15 14:53:29.362845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:53:29.362845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:53:29.362845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Instance a97884f7-868c-4b2a-b518-feac560b9eff could not be found. Jun 15 14:53:29.362845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': 'a97884f7-868c-4b2a-b518-feac560b9eff'} Jun 15 14:53:29.363657 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:53:29.363657 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:53:29.363657 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:53:29.363657 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:53:29.363657 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:53:29.363657 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:53:29.363657 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:53:29.363657 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:53:29.363657 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:53:29.363657 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:53:29.363657 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a97884f7-868c-4b2a-b518-feac560b9eff could not be found. Jun 15 14:53:29.363657 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:53:29.363657 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:53:29.363657 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:53:29.363657 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:53:29.363657 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:53:29.363657 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:53:29.363657 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:53:29.363657 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:53:29.363657 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:53:29.365018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:53:29.365018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:53:29.365018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:53:29.365018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:53:29.365018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:53:29.365018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:53:29.365018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:53:29.365018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a97884f7-868c-4b2a-b518-feac560b9eff could not be found. Jun 15 14:53:29.365018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:53:29.365018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:53:29.365018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:53:29.365018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:53:29.365018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:53:29.365018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:53:29.365018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:53:29.365018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:53:29.365018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a97884f7-868c-4b2a-b518-feac560b9eff could not be found. Jun 15 14:53:29.365018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:53:29.366658 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e4a04b03-4f25-413a-9a6e-36bbba16a79f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Returning 404 to user: Instance a97884f7-868c-4b2a-b518-feac560b9eff could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:53:29.366658 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-e4a04b03-4f25-413a-9a6e-36bbba16a79f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 404 len: 111 microversion: 2.1 time: 0.031041 Jun 15 14:53:29.366658 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 581/1133] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:29 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:53:29.371239 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-daaeb698-3e2c-4e9f-b1e7-77b632710d81 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '.version_select at 0x7f8f2136e670>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:29.391058 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-daaeb698-3e2c-4e9f-b1e7-77b632710d81 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1273608603" status: 202 len: 0 microversion: 2.1 time: 0.023512 Jun 15 14:53:29.391887 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 553/1134] 10.222.0.57 () {58 vars in 1220 bytes} [Wed Jun 15 14:53:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1273608603 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:53:30.013288 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-7391c311-dc4d-47e3-bbd1-0c8ab981d4a0 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Action: 'create', calling method: .version_select at 0x7f8f20048dc0>, body: {"keypair": {"name": "tempest-keypair-1418146719", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKX2I2PxQbF57VUiwDTzTGzGDcIYJ5xsXsAFMCcwroh1HYRE7m8dKw/BpfKVX7g5y/DpLie5jwMeCv6QziNHU+JI0uO0vCcaot6CX3jPP1KzUOewO8UKlzslIDtDWZBlUg=="}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:53:30.027512 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-7391c311-dc4d-47e3-bbd1-0c8ab981d4a0 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Getting quotas for project 591d111357224477998b265d45e3ee0d. Resources: {'key_pairs'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:53:30.031409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-7391c311-dc4d-47e3-bbd1-0c8ab981d4a0 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Getting quotas for user 6caa64aecb914e968d057b6b593f667f and project 591d111357224477998b265d45e3ee0d. Resources: {'key_pairs'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:53:30.053243 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-7391c311-dc4d-47e3-bbd1-0c8ab981d4a0 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043807 Jun 15 14:53:30.053793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 582/1135] 10.222.0.57 () {60 vars in 1158 bytes} [Wed Jun 15 14:53:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:53:31.564193 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-f6f4b4d4-efef-448c-b39e-339b6c4c8f4b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-857005461", "imageRef": "e18802bf-9dac-462c-88ba-5cce79043279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ffec14f9-f069-4e9d-93e1-f0addcf3eda2"}], "security_groups": [{"name": "tempest-securitygroup--1012470406"}], "key_name": "tempest-keypair-1418146719", "user_data": "}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:53:31.664767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.network.neutron [None req-f6f4b4d4-efef-448c-b39e-339b6c4c8f4b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] validate_networks() for [('ffec14f9-f069-4e9d-93e1-f0addcf3eda2', None, None, None, None, None)] {{(pid=124220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:53:32.052712 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-f6f4b4d4-efef-448c-b39e-339b6c4c8f4b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Flavor limits 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:53:32.053173 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-f6f4b4d4-efef-448c-b39e-339b6c4c8f4b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Image limits 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:53:32.053651 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-f6f4b4d4-efef-448c-b39e-339b6c4c8f4b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Flavor pref 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:53:32.054097 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-f6f4b4d4-efef-448c-b39e-339b6c4c8f4b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Image pref 0:0:0 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:53:32.054512 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.virt.hardware [None req-f6f4b4d4-efef-448c-b39e-339b6c4c8f4b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:53:32.063499 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f6f4b4d4-efef-448c-b39e-339b6c4c8f4b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:32.063953 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f6f4b4d4-efef-448c-b39e-339b6c4c8f4b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:32.064874 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f6f4b4d4-efef-448c-b39e-339b6c4c8f4b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:32.065215 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f6f4b4d4-efef-448c-b39e-339b6c4c8f4b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:32.083137 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-f6f4b4d4-efef-448c-b39e-339b6c4c8f4b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Getting quotas for project 591d111357224477998b265d45e3ee0d. Resources: {'cores', 'instances', 'ram'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:53:32.087270 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-f6f4b4d4-efef-448c-b39e-339b6c4c8f4b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Getting quotas for user 6caa64aecb914e968d057b6b593f667f and project 591d111357224477998b265d45e3ee0d. Resources: {'cores', 'instances', 'ram'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:53:32.099341 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-f6f4b4d4-efef-448c-b39e-339b6c4c8f4b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Going to run 1 instances... {{(pid=124220) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:53:32.101620 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-f6f4b4d4-efef-448c-b39e-339b6c4c8f4b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e18802bf-9dac-462c-88ba-5cce79043279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:53:32.148209 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-f6f4b4d4-efef-448c-b39e-339b6c4c8f4b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.589501 Jun 15 14:53:32.148853 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 554/1136] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 14:53:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:53:32.160436 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-2373196a-41ce-45d6-b4da-10e5343a2b92 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:32.161051 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-2373196a-41ce-45d6-b4da-10e5343a2b92 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:32.214945 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-2373196a-41ce-45d6-b4da-10e5343a2b92 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:32.222270 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-2373196a-41ce-45d6-b4da-10e5343a2b92 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929" status: 200 len: 1241 microversion: 2.1 time: 0.067318 Jun 15 14:53:32.222827 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 583/1137] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:32 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:33.240791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-8a2c7fe2-1a42-4df1-94b9-bba866dbf1f8 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:33.242260 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-8a2c7fe2-1a42-4df1-94b9-bba866dbf1f8 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:33.248992 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8a2c7fe2-1a42-4df1-94b9-bba866dbf1f8 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:33.249654 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8a2c7fe2-1a42-4df1-94b9-bba866dbf1f8 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:33.250640 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8a2c7fe2-1a42-4df1-94b9-bba866dbf1f8 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:33.251252 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8a2c7fe2-1a42-4df1-94b9-bba866dbf1f8 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:33.337413 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-8a2c7fe2-1a42-4df1-94b9-bba866dbf1f8 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:33.348804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-8a2c7fe2-1a42-4df1-94b9-bba866dbf1f8 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929" status: 200 len: 1301 microversion: 2.1 time: 0.113082 Jun 15 14:53:33.350423 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 555/1138] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:33 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 => generated 1301 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:34.367084 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-a8061d7f-f6f8-4917-bd14-d47407bc8097 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:34.367644 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-a8061d7f-f6f8-4917-bd14-d47407bc8097 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:34.374860 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a8061d7f-f6f8-4917-bd14-d47407bc8097 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:34.375345 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a8061d7f-f6f8-4917-bd14-d47407bc8097 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:34.376462 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a8061d7f-f6f8-4917-bd14-d47407bc8097 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:34.377003 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a8061d7f-f6f8-4917-bd14-d47407bc8097 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:34.516120 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-a8061d7f-f6f8-4917-bd14-d47407bc8097 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:34.530393 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-a8061d7f-f6f8-4917-bd14-d47407bc8097 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929" status: 200 len: 1367 microversion: 2.1 time: 0.166496 Jun 15 14:53:34.531270 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 584/1139] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:34 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:34.736177 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-51977a80-f7e2-44a7-b2de-e2e7a6a1d48e req-c099c98f-72f0-47eb-921e-46b5f7771622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15951a8f-0c58-442e-92b4-7e05d00d2929", "tag": "a8571909-2726-4ef4-a5fb-b34baa8ca224"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:53:34.748083 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-51977a80-f7e2-44a7-b2de-e2e7a6a1d48e req-c099c98f-72f0-47eb-921e-46b5f7771622 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:34.748810 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-51977a80-f7e2-44a7-b2de-e2e7a6a1d48e req-c099c98f-72f0-47eb-921e-46b5f7771622 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:34.762350 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-51977a80-f7e2-44a7-b2de-e2e7a6a1d48e req-c099c98f-72f0-47eb-921e-46b5f7771622 service nova] Creating event network-changed:a8571909-2726-4ef4-a5fb-b34baa8ca224 for instance 15951a8f-0c58-442e-92b4-7e05d00d2929 on hv-cinder-84327 Jun 15 14:53:34.768488 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-51977a80-f7e2-44a7-b2de-e2e7a6a1d48e req-c099c98f-72f0-47eb-921e-46b5f7771622 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036940 Jun 15 14:53:34.769094 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 556/1140] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:53:35.547787 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-e28947c8-e380-486a-a697-72ca205674e5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:35.548395 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-e28947c8-e380-486a-a697-72ca205674e5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:35.554882 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e28947c8-e380-486a-a697-72ca205674e5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:35.555334 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e28947c8-e380-486a-a697-72ca205674e5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:35.556094 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e28947c8-e380-486a-a697-72ca205674e5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:35.556532 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-e28947c8-e380-486a-a697-72ca205674e5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:35.687994 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-e28947c8-e380-486a-a697-72ca205674e5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:35.695428 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-e28947c8-e380-486a-a697-72ca205674e5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929" status: 200 len: 1367 microversion: 2.1 time: 0.151545 Jun 15 14:53:35.695986 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 585/1141] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:35 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:36.714483 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-f6ade1c0-cbac-420c-bc13-8fd91fc9965c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:36.715211 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-f6ade1c0-cbac-420c-bc13-8fd91fc9965c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:36.722639 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f6ade1c0-cbac-420c-bc13-8fd91fc9965c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:36.723205 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f6ade1c0-cbac-420c-bc13-8fd91fc9965c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:36.724096 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f6ade1c0-cbac-420c-bc13-8fd91fc9965c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:36.724603 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f6ade1c0-cbac-420c-bc13-8fd91fc9965c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:36.854011 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-f6ade1c0-cbac-420c-bc13-8fd91fc9965c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:36.861763 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-f6ade1c0-cbac-420c-bc13-8fd91fc9965c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929" status: 200 len: 1367 microversion: 2.1 time: 0.151751 Jun 15 14:53:36.862327 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 557/1142] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:36 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:37.878999 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-fa6e1110-fc29-41c9-8135-aa0d028679fd tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:37.879607 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-fa6e1110-fc29-41c9-8135-aa0d028679fd tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:37.886065 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fa6e1110-fc29-41c9-8135-aa0d028679fd tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:37.886514 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fa6e1110-fc29-41c9-8135-aa0d028679fd tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:37.887264 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fa6e1110-fc29-41c9-8135-aa0d028679fd tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:37.887697 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-fa6e1110-fc29-41c9-8135-aa0d028679fd tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:38.016136 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-fa6e1110-fc29-41c9-8135-aa0d028679fd tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:38.023511 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-fa6e1110-fc29-41c9-8135-aa0d028679fd tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929" status: 200 len: 1367 microversion: 2.1 time: 0.148411 Jun 15 14:53:38.024075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 586/1143] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:37 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:39.040307 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-3cacebb7-ea24-4a80-adff-16cf1702e397 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:39.040921 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-3cacebb7-ea24-4a80-adff-16cf1702e397 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:39.047564 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3cacebb7-ea24-4a80-adff-16cf1702e397 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:39.048020 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3cacebb7-ea24-4a80-adff-16cf1702e397 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:39.048786 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3cacebb7-ea24-4a80-adff-16cf1702e397 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:39.049229 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-3cacebb7-ea24-4a80-adff-16cf1702e397 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:39.200092 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-3cacebb7-ea24-4a80-adff-16cf1702e397 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:39.208514 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-3cacebb7-ea24-4a80-adff-16cf1702e397 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929" status: 200 len: 1367 microversion: 2.1 time: 0.172048 Jun 15 14:53:39.209090 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 558/1144] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:39 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:40.225894 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-9b9d366b-64de-4b46-b759-df25a5a12f51 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:40.226521 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-9b9d366b-64de-4b46-b759-df25a5a12f51 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:40.233449 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9b9d366b-64de-4b46-b759-df25a5a12f51 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:40.233991 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9b9d366b-64de-4b46-b759-df25a5a12f51 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:40.234789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9b9d366b-64de-4b46-b759-df25a5a12f51 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:40.235225 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9b9d366b-64de-4b46-b759-df25a5a12f51 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:40.369457 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-9b9d366b-64de-4b46-b759-df25a5a12f51 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:40.377821 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-9b9d366b-64de-4b46-b759-df25a5a12f51 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929" status: 200 len: 1367 microversion: 2.1 time: 0.155825 Jun 15 14:53:40.378591 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 587/1145] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:40 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:41.395906 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-8f0c7793-001b-490c-8ff0-e57a26515bd3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:41.396514 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-8f0c7793-001b-490c-8ff0-e57a26515bd3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:41.403155 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8f0c7793-001b-490c-8ff0-e57a26515bd3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:41.403598 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8f0c7793-001b-490c-8ff0-e57a26515bd3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:41.404360 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8f0c7793-001b-490c-8ff0-e57a26515bd3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:41.404791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-8f0c7793-001b-490c-8ff0-e57a26515bd3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:41.552816 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-8f0c7793-001b-490c-8ff0-e57a26515bd3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:41.560318 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-8f0c7793-001b-490c-8ff0-e57a26515bd3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929" status: 200 len: 1367 microversion: 2.1 time: 0.169185 Jun 15 14:53:41.560876 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 559/1146] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:41 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:42.578271 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-6711c173-f02a-4dc0-862a-a1e61717201d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:42.578874 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-6711c173-f02a-4dc0-862a-a1e61717201d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:42.581282 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=6 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:42.586708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6711c173-f02a-4dc0-862a-a1e61717201d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:42.587160 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6711c173-f02a-4dc0-862a-a1e61717201d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:42.587923 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6711c173-f02a-4dc0-862a-a1e61717201d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:42.588358 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6711c173-f02a-4dc0-862a-a1e61717201d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:42.606591 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:42.719733 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-6711c173-f02a-4dc0-862a-a1e61717201d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:42.727164 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-6711c173-f02a-4dc0-862a-a1e61717201d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929" status: 200 len: 1367 microversion: 2.1 time: 0.153450 Jun 15 14:53:42.727736 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 588/1147] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:42 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:43.744420 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6faa28e1-1a56-4fd1-855d-b241223a947b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:43.744964 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6faa28e1-1a56-4fd1-855d-b241223a947b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:43.746981 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=2 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:43.747646 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=6 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:43.754208 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6faa28e1-1a56-4fd1-855d-b241223a947b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:43.754666 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6faa28e1-1a56-4fd1-855d-b241223a947b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:43.755430 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6faa28e1-1a56-4fd1-855d-b241223a947b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:43.755871 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6faa28e1-1a56-4fd1-855d-b241223a947b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:43.881704 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6faa28e1-1a56-4fd1-855d-b241223a947b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:43.889012 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-6faa28e1-1a56-4fd1-855d-b241223a947b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929" status: 200 len: 1367 microversion: 2.1 time: 0.148580 Jun 15 14:53:43.889563 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 560/1148] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:43 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:44.905160 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-86787fb0-e928-47de-8e3e-9abf4c145b22 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:44.905899 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-86787fb0-e928-47de-8e3e-9abf4c145b22 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:44.912599 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-86787fb0-e928-47de-8e3e-9abf4c145b22 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:44.913055 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-86787fb0-e928-47de-8e3e-9abf4c145b22 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:44.913853 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-86787fb0-e928-47de-8e3e-9abf4c145b22 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:44.914297 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-86787fb0-e928-47de-8e3e-9abf4c145b22 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:45.044056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-86787fb0-e928-47de-8e3e-9abf4c145b22 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:45.052649 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-86787fb0-e928-47de-8e3e-9abf4c145b22 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929" status: 200 len: 1367 microversion: 2.1 time: 0.151321 Jun 15 14:53:45.053212 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 589/1149] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:44 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:46.069400 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-07bf4c37-c0bd-48c2-a4f8-10f76da8a0f6 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:46.070015 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-07bf4c37-c0bd-48c2-a4f8-10f76da8a0f6 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:46.076573 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-07bf4c37-c0bd-48c2-a4f8-10f76da8a0f6 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:46.077014 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-07bf4c37-c0bd-48c2-a4f8-10f76da8a0f6 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:46.077892 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-07bf4c37-c0bd-48c2-a4f8-10f76da8a0f6 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:46.079393 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-07bf4c37-c0bd-48c2-a4f8-10f76da8a0f6 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:46.212620 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-07bf4c37-c0bd-48c2-a4f8-10f76da8a0f6 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:46.214863 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=97 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:46.221922 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-07bf4c37-c0bd-48c2-a4f8-10f76da8a0f6 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929" status: 200 len: 1367 microversion: 2.1 time: 0.156100 Jun 15 14:53:46.222505 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 561/1150] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:46 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:47.240611 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-34aca8b3-885c-4720-8ed1-afe9b13f26fb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:47.241149 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-34aca8b3-885c-4720-8ed1-afe9b13f26fb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:47.243532 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:47.249261 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-34aca8b3-885c-4720-8ed1-afe9b13f26fb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:47.249730 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-34aca8b3-885c-4720-8ed1-afe9b13f26fb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:47.250618 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-34aca8b3-885c-4720-8ed1-afe9b13f26fb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:47.251086 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-34aca8b3-885c-4720-8ed1-afe9b13f26fb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:47.382072 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-34aca8b3-885c-4720-8ed1-afe9b13f26fb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:47.389780 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-34aca8b3-885c-4720-8ed1-afe9b13f26fb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929" status: 200 len: 1367 microversion: 2.1 time: 0.154511 Jun 15 14:53:47.390351 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 590/1151] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:47 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:47.493165 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-ed03ac59-2636-4c25-ac0c-6117869b2642 req-09c2b915-9f53-46a6-858e-8fe04fd8e5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15951a8f-0c58-442e-92b4-7e05d00d2929", "name": "network-vif-plugged", "status": "completed", "tag": "a8571909-2726-4ef4-a5fb-b34baa8ca224"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:53:47.498505 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:47.503312 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-ed03ac59-2636-4c25-ac0c-6117869b2642 req-09c2b915-9f53-46a6-858e-8fe04fd8e5c2 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:47.503791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-ed03ac59-2636-4c25-ac0c-6117869b2642 req-09c2b915-9f53-46a6-858e-8fe04fd8e5c2 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:47.516898 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-ed03ac59-2636-4c25-ac0c-6117869b2642 req-09c2b915-9f53-46a6-858e-8fe04fd8e5c2 service nova] Creating event network-vif-plugged:a8571909-2726-4ef4-a5fb-b34baa8ca224 for instance 15951a8f-0c58-442e-92b4-7e05d00d2929 on hv-cinder-84327 Jun 15 14:53:47.521979 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-ed03ac59-2636-4c25-ac0c-6117869b2642 req-09c2b915-9f53-46a6-858e-8fe04fd8e5c2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032530 Jun 15 14:53:47.523189 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 562/1152] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:53:48.407761 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-80953a59-d711-44f0-a4ff-d053d10fd38c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:48.408373 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-80953a59-d711-44f0-a4ff-d053d10fd38c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:48.414898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-80953a59-d711-44f0-a4ff-d053d10fd38c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:48.415347 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-80953a59-d711-44f0-a4ff-d053d10fd38c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:48.416104 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-80953a59-d711-44f0-a4ff-d053d10fd38c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:48.416541 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-80953a59-d711-44f0-a4ff-d053d10fd38c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:48.547903 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-80953a59-d711-44f0-a4ff-d053d10fd38c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:48.555240 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-80953a59-d711-44f0-a4ff-d053d10fd38c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929" status: 200 len: 1367 microversion: 2.1 time: 0.152011 Jun 15 14:53:48.555815 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 591/1153] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:48 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:49.573398 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-2f31125f-8cc9-40c7-b7e8-95a5633893e3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:49.574236 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-2f31125f-8cc9-40c7-b7e8-95a5633893e3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:49.580738 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2f31125f-8cc9-40c7-b7e8-95a5633893e3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:49.581204 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2f31125f-8cc9-40c7-b7e8-95a5633893e3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:49.581989 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2f31125f-8cc9-40c7-b7e8-95a5633893e3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:49.582424 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2f31125f-8cc9-40c7-b7e8-95a5633893e3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:49.713922 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-2f31125f-8cc9-40c7-b7e8-95a5633893e3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:49.721981 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-2f31125f-8cc9-40c7-b7e8-95a5633893e3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929" status: 200 len: 1367 microversion: 2.1 time: 0.153270 Jun 15 14:53:49.722551 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 563/1154] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:49 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:50.739199 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-9cb67554-3581-4a39-8ed6-f87f35e1075b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:50.739753 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-9cb67554-3581-4a39-8ed6-f87f35e1075b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:50.746427 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9cb67554-3581-4a39-8ed6-f87f35e1075b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:50.746877 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9cb67554-3581-4a39-8ed6-f87f35e1075b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:50.747636 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9cb67554-3581-4a39-8ed6-f87f35e1075b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:50.748073 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9cb67554-3581-4a39-8ed6-f87f35e1075b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:50.875509 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-9cb67554-3581-4a39-8ed6-f87f35e1075b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:50.882867 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-9cb67554-3581-4a39-8ed6-f87f35e1075b tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929" status: 200 len: 1557 microversion: 2.1 time: 0.148473 Jun 15 14:53:50.883425 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 592/1155] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:50 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:50.899546 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c50a3053-3026-45b0-a863-eb0c08db29fe tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:50.900044 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-c50a3053-3026-45b0-a863-eb0c08db29fe tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:50.907344 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c50a3053-3026-45b0-a863-eb0c08db29fe tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:50.907794 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c50a3053-3026-45b0-a863-eb0c08db29fe tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:50.908565 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c50a3053-3026-45b0-a863-eb0c08db29fe tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:50.909035 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c50a3053-3026-45b0-a863-eb0c08db29fe tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:50.989287 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-c50a3053-3026-45b0-a863-eb0c08db29fe tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093574 Jun 15 14:53:50.989860 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 564/1156] 10.222.0.57 () {58 vars in 1274 bytes} [Wed Jun 15 14:53:50 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:53:51.941075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-96d908fe-b3ae-4ed9-903c-b7d589c86a4c req-067bba85-deab-4979-a71b-0b081d6be810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15951a8f-0c58-442e-92b4-7e05d00d2929", "tag": "a8571909-2726-4ef4-a5fb-b34baa8ca224"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:53:51.949616 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-96d908fe-b3ae-4ed9-903c-b7d589c86a4c req-067bba85-deab-4979-a71b-0b081d6be810 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:51.950094 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-96d908fe-b3ae-4ed9-903c-b7d589c86a4c req-067bba85-deab-4979-a71b-0b081d6be810 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:51.962000 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-96d908fe-b3ae-4ed9-903c-b7d589c86a4c req-067bba85-deab-4979-a71b-0b081d6be810 service nova] Creating event network-changed:a8571909-2726-4ef4-a5fb-b34baa8ca224 for instance 15951a8f-0c58-442e-92b4-7e05d00d2929 on hv-cinder-84327 Jun 15 14:53:51.967110 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-96d908fe-b3ae-4ed9-903c-b7d589c86a4c req-067bba85-deab-4979-a71b-0b081d6be810 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030343 Jun 15 14:53:51.967698 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 593/1157] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:54:28.110000 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=5 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:28.110927 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=13 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:28.115809 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-b3b5786f-f142-46ba-a225-a56171ab826f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:28.116302 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-b3b5786f-f142-46ba-a225-a56171ab826f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:28.123436 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b3b5786f-f142-46ba-a225-a56171ab826f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:28.123888 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b3b5786f-f142-46ba-a225-a56171ab826f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:28.124685 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b3b5786f-f142-46ba-a225-a56171ab826f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:28.125117 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b3b5786f-f142-46ba-a225-a56171ab826f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:28.147649 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-b3b5786f-f142-46ba-a225-a56171ab826f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929/ips" status: 200 len: 149 microversion: 2.1 time: 0.039697 Jun 15 14:54:28.148790 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 565/1158] 10.222.0.57 () {58 vars in 1247 bytes} [Wed Jun 15 14:54:28 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:54:29.469858 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=7 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:29.470601 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=28 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:29.475622 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-9907c30a-dcad-4d19-904c-0ba99ce16fdb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34c1a2a9-8625-44d1-a527-bf2cfdef6f7d"}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:29.477679 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-9907c30a-dcad-4d19-904c-0ba99ce16fdb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:29.484834 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9907c30a-dcad-4d19-904c-0ba99ce16fdb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:29.485281 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9907c30a-dcad-4d19-904c-0ba99ce16fdb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:29.486166 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9907c30a-dcad-4d19-904c-0ba99ce16fdb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:29.486604 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-9907c30a-dcad-4d19-904c-0ba99ce16fdb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:29.752888 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-9907c30a-dcad-4d19-904c-0ba99ce16fdb tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "POST /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284664 Jun 15 14:54:29.753603 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 594/1159] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 14:54:29 2022] POST /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:54:37.236252 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-370d4983-583a-4fda-8fe7-6f333718ca27 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34c1a2a9-8625-44d1-a527-bf2cfdef6f7d"}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:37.237338 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-370d4983-583a-4fda-8fe7-6f333718ca27 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:37.244403 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-370d4983-583a-4fda-8fe7-6f333718ca27 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:37.244849 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-370d4983-583a-4fda-8fe7-6f333718ca27 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:37.245606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-370d4983-583a-4fda-8fe7-6f333718ca27 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:37.246071 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-370d4983-583a-4fda-8fe7-6f333718ca27 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:37.323660 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.wsgi [None req-370d4983-583a-4fda-8fe7-6f333718ca27 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] HTTP exception thrown: Invalid volume: volume 34c1a2a9-8625-44d1-a527-bf2cfdef6f7d is already attached to instances: 15951a8f-0c58-442e-92b4-7e05d00d2929 Jun 15 14:54:37.325365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-370d4983-583a-4fda-8fe7-6f333718ca27 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Request method failure captured: Jun 15 14:54:37.325365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: request: POST /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929/os-volume_attachments HTTP/1.1 Jun 15 14:54:37.325365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept: application/json Jun 15 14:54:37.325365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept-Encoding: identity Jun 15 14:54:37.325365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Connection: close Jun 15 14:54:37.325365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Length: 74 Jun 15 14:54:37.325365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Type: application/json Jun 15 14:54:37.325365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Host: 10.222.0.57 Jun 15 14:54:37.325365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Openstack-System-Scope: None Jun 15 14:54:37.325365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: User-Agent: python-urllib3/1.26.9 Jun 15 14:54:37.325365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Auth-Token: gAAAAABiqfGtA81J1G_x2ff3wIk9WNt3QYmnBm26jR3C1Gs2is-P7wpJkQsDSBdU7d-N9JTLRxl70QNiPGwIBDR5YY-rvbFUD77VY73Ns036wSG64JihGQQVBXgVpi8TCxZ4jrtMxLvpDXwplGMkMYm1p0WTNbEoOI9C6x7l5c7PYtxIYCxejUU Jun 15 14:54:37.325365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Id: None Jun 15 14:54:37.325365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Name: None Jun 15 14:54:37.325365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Identity-Status: Confirmed Jun 15 14:54:37.325365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Is-Admin-Project: True Jun 15 14:54:37.325365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Id: default Jun 15 14:54:37.325365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Name: Default Jun 15 14:54:37.325365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:54:37.325365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:54:37.325365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Role: member,reader Jun 15 14:54:37.325365 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Roles: member,reader Jun 15 14:54:37.327071 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_591d111357224477998b265d45e3ee0d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/591d111357224477998b265d45e3ee0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:54:37.327071 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:54:37.327071 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:54:37.327071 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:54:37.327071 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:54:37.327071 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Id: default Jun 15 14:54:37.327071 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Name: Default Jun 15 14:54:37.327071 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Id: 6caa64aecb914e968d057b6b593f667f Jun 15 14:54:37.327071 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Name: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:54:37.327071 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Jun 15 14:54:37.327071 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {"volumeAttachment": {"volumeId": "34c1a2a9-8625-44d1-a527-bf2cfdef6f7d"}} Jun 15 14:54:37.327071 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: method: > Jun 15 14:54:37.327983 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: exception: Invalid volume: volume 34c1a2a9-8625-44d1-a527-bf2cfdef6f7d is already attached to instances: 15951a8f-0c58-442e-92b4-7e05d00d2929 Jun 15 14:54:37.327983 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: action_args: {'server_id': '15951a8f-0c58-442e-92b4-7e05d00d2929', 'body': {'volumeAttachment': {'volumeId': '34c1a2a9-8625-44d1-a527-bf2cfdef6f7d'}}} Jun 15 14:54:37.327983 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:54:37.327983 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:37.327983 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 14:54:37.327983 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 14:54:37.327983 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 14:54:37.327983 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 14:54:37.327983 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 14:54:37.327983 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 14:54:37.327983 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 15 14:54:37.327983 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 15 14:54:37.327983 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 15 14:54:37.327983 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 15 14:54:37.327983 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 34c1a2a9-8625-44d1-a527-bf2cfdef6f7d is already attached to instances: 15951a8f-0c58-442e-92b4-7e05d00d2929 Jun 15 14:54:37.327983 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:54:37.327983 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:54:37.327983 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:54:37.327983 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:37.329431 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:54:37.329431 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:54:37.329431 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:54:37.329431 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:54:37.329431 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:54:37.329431 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:54:37.329431 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 14:54:37.329431 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:54:37.329431 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 14:54:37.329431 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:54:37.329431 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 14:54:37.329431 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:54:37.329431 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 15 14:54:37.329431 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 14:54:37.329431 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 34c1a2a9-8625-44d1-a527-bf2cfdef6f7d is already attached to instances: 15951a8f-0c58-442e-92b4-7e05d00d2929 Jun 15 14:54:37.329431 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:54:37.329431 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:54:37.329431 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:54:37.329431 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:37.329431 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:54:37.330954 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:54:37.330954 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:54:37.330954 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:54:37.330954 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 34c1a2a9-8625-44d1-a527-bf2cfdef6f7d is already attached to instances: 15951a8f-0c58-442e-92b4-7e05d00d2929 Jun 15 14:54:37.330954 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:54:37.330954 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-370d4983-583a-4fda-8fe7-6f333718ca27 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Returning 400 to user: Invalid volume: volume 34c1a2a9-8625-44d1-a527-bf2cfdef6f7d is already attached to instances: 15951a8f-0c58-442e-92b4-7e05d00d2929 {{(pid=124220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:54:37.330954 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-370d4983-583a-4fda-8fe7-6f333718ca27 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "POST /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094872 Jun 15 14:54:37.330954 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 566/1160] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 14:54:37 2022] POST /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 14:54:37.389591 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-07308fd2-d0db-45b3-a33e-5d0bf9e2768c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:37.390151 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-07308fd2-d0db-45b3-a33e-5d0bf9e2768c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:37.396350 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-07308fd2-d0db-45b3-a33e-5d0bf9e2768c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:37.396801 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-07308fd2-d0db-45b3-a33e-5d0bf9e2768c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:37.397568 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-07308fd2-d0db-45b3-a33e-5d0bf9e2768c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:37.398052 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-07308fd2-d0db-45b3-a33e-5d0bf9e2768c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:37.478267 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.objects.instance [None req-07308fd2-d0db-45b3-a33e-5d0bf9e2768c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lazy-loading 'services' on Instance uuid 15951a8f-0c58-442e-92b4-7e05d00d2929 {{(pid=124219) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:54:37.549298 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-07308fd2-d0db-45b3-a33e-5d0bf9e2768c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "DELETE /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929/os-volume_attachments/34c1a2a9-8625-44d1-a527-bf2cfdef6f7d" status: 202 len: 0 microversion: 2.1 time: 0.164302 Jun 15 14:54:37.549930 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 595/1161] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Jun 15 14:54:37 2022] DELETE /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929/os-volume_attachments/34c1a2a9-8625-44d1-a527-bf2cfdef6f7d => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 14:54:37.559073 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-29e93ec3-dd57-41e3-bc9f-75d18227dc86 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:37.559998 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-29e93ec3-dd57-41e3-bc9f-75d18227dc86 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:37.566028 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-29e93ec3-dd57-41e3-bc9f-75d18227dc86 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:37.566486 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-29e93ec3-dd57-41e3-bc9f-75d18227dc86 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:37.567251 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-29e93ec3-dd57-41e3-bc9f-75d18227dc86 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:37.567687 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-29e93ec3-dd57-41e3-bc9f-75d18227dc86 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:37.600347 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-29e93ec3-dd57-41e3-bc9f-75d18227dc86 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046059 Jun 15 14:54:37.600898 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 567/1162] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 14:54:37 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:54:38.613482 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-ed596e48-96d2-418e-8352-054983bc63ba tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:38.614575 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-ed596e48-96d2-418e-8352-054983bc63ba tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:38.621842 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ed596e48-96d2-418e-8352-054983bc63ba tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:38.622295 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ed596e48-96d2-418e-8352-054983bc63ba tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:38.623058 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ed596e48-96d2-418e-8352-054983bc63ba tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:38.623495 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ed596e48-96d2-418e-8352-054983bc63ba tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:38.652006 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-ed596e48-96d2-418e-8352-054983bc63ba tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043029 Jun 15 14:54:38.652484 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 596/1163] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 14:54:38 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 14:54:38.709012 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6d70badd-bf3d-498a-a90f-8efea448900c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:38.709509 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6d70badd-bf3d-498a-a90f-8efea448900c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:38.716974 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6d70badd-bf3d-498a-a90f-8efea448900c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:38.717417 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6d70badd-bf3d-498a-a90f-8efea448900c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:38.718206 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6d70badd-bf3d-498a-a90f-8efea448900c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:38.718640 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6d70badd-bf3d-498a-a90f-8efea448900c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:38.745560 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6d70badd-bf3d-498a-a90f-8efea448900c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Going to try to terminate instance {{(pid=124220) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:54:38.822995 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-6d70badd-bf3d-498a-a90f-8efea448900c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "DELETE /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929" status: 204 len: 0 microversion: 2.1 time: 0.117610 Jun 15 14:54:38.823585 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 568/1164] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:54:38 2022] DELETE /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:54:38.832031 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-73be7cf8-2596-4daf-9054-a788d29ab1b8 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:38.832654 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-73be7cf8-2596-4daf-9054-a788d29ab1b8 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:38.838784 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-73be7cf8-2596-4daf-9054-a788d29ab1b8 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:38.839260 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-73be7cf8-2596-4daf-9054-a788d29ab1b8 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:38.840019 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-73be7cf8-2596-4daf-9054-a788d29ab1b8 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:38.840480 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-73be7cf8-2596-4daf-9054-a788d29ab1b8 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:38.968671 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-73be7cf8-2596-4daf-9054-a788d29ab1b8 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:38.976156 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-73be7cf8-2596-4daf-9054-a788d29ab1b8 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929" status: 200 len: 1681 microversion: 2.1 time: 0.148204 Jun 15 14:54:38.977219 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 597/1165] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:38 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:39.995063 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-907b4004-da05-4568-b8eb-0accb72e1b25 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:39.995691 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-907b4004-da05-4568-b8eb-0accb72e1b25 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:40.002158 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-907b4004-da05-4568-b8eb-0accb72e1b25 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:40.002616 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-907b4004-da05-4568-b8eb-0accb72e1b25 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:40.003382 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-907b4004-da05-4568-b8eb-0accb72e1b25 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:40.003819 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-907b4004-da05-4568-b8eb-0accb72e1b25 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:40.136936 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-907b4004-da05-4568-b8eb-0accb72e1b25 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:40.144603 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-907b4004-da05-4568-b8eb-0accb72e1b25 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929" status: 200 len: 1681 microversion: 2.1 time: 0.154159 Jun 15 14:54:40.145189 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 569/1166] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:39 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:41.161614 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-93cd8eeb-0a45-4c60-a3f8-f752b1c18e62 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:41.162251 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-93cd8eeb-0a45-4c60-a3f8-f752b1c18e62 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:41.169811 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-93cd8eeb-0a45-4c60-a3f8-f752b1c18e62 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:41.170260 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-93cd8eeb-0a45-4c60-a3f8-f752b1c18e62 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:41.171013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-93cd8eeb-0a45-4c60-a3f8-f752b1c18e62 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:41.171445 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-93cd8eeb-0a45-4c60-a3f8-f752b1c18e62 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:41.305995 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-93cd8eeb-0a45-4c60-a3f8-f752b1c18e62 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:41.314134 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-93cd8eeb-0a45-4c60-a3f8-f752b1c18e62 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929" status: 200 len: 1681 microversion: 2.1 time: 0.156203 Jun 15 14:54:41.314938 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 598/1167] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:41 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:42.000877 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-81f2fdee-ed8a-47de-be2f-fe4634e068cc req-6da5460d-a73a-4b56-b2c2-108193f844d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15951a8f-0c58-442e-92b4-7e05d00d2929", "name": "network-vif-deleted", "tag": "a8571909-2726-4ef4-a5fb-b34baa8ca224"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:42.011603 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-81f2fdee-ed8a-47de-be2f-fe4634e068cc req-6da5460d-a73a-4b56-b2c2-108193f844d6 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:42.012054 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-81f2fdee-ed8a-47de-be2f-fe4634e068cc req-6da5460d-a73a-4b56-b2c2-108193f844d6 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:42.025480 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-81f2fdee-ed8a-47de-be2f-fe4634e068cc req-6da5460d-a73a-4b56-b2c2-108193f844d6 service nova] Creating event network-vif-deleted:a8571909-2726-4ef4-a5fb-b34baa8ca224 for instance 15951a8f-0c58-442e-92b4-7e05d00d2929 on hv-cinder-84327 Jun 15 14:54:42.032016 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-81f2fdee-ed8a-47de-be2f-fe4634e068cc req-6da5460d-a73a-4b56-b2c2-108193f844d6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.268715 Jun 15 14:54:42.035355 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 570/1168] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:54:42.332273 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-89ef5278-0f1a-4156-98c9-5e1c3d59ba37 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:42.333006 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-89ef5278-0f1a-4156-98c9-5e1c3d59ba37 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:42.341980 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-89ef5278-0f1a-4156-98c9-5e1c3d59ba37 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:42.342949 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-89ef5278-0f1a-4156-98c9-5e1c3d59ba37 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:42.343465 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-89ef5278-0f1a-4156-98c9-5e1c3d59ba37 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:42.348343 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-89ef5278-0f1a-4156-98c9-5e1c3d59ba37 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:42.382372 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-89ef5278-0f1a-4156-98c9-5e1c3d59ba37 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:42.384133 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-89ef5278-0f1a-4156-98c9-5e1c3d59ba37 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:42.384658 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.objects.instance [None req-89ef5278-0f1a-4156-98c9-5e1c3d59ba37 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lazy-loading 'fault' on Instance uuid 15951a8f-0c58-442e-92b4-7e05d00d2929 {{(pid=124219) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:54:42.434270 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-89ef5278-0f1a-4156-98c9-5e1c3d59ba37 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:42.441921 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-89ef5278-0f1a-4156-98c9-5e1c3d59ba37 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929" status: 200 len: 1331 microversion: 2.1 time: 0.113423 Jun 15 14:54:42.442506 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 599/1169] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:42 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:43.460156 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-97d9ae1a-8318-41d6-8976-86529987d2c2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:43.461904 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-97d9ae1a-8318-41d6-8976-86529987d2c2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:43.470241 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-97d9ae1a-8318-41d6-8976-86529987d2c2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:43.471071 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-97d9ae1a-8318-41d6-8976-86529987d2c2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:43.471884 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-97d9ae1a-8318-41d6-8976-86529987d2c2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:43.472698 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-97d9ae1a-8318-41d6-8976-86529987d2c2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:43.487623 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.wsgi [None req-97d9ae1a-8318-41d6-8976-86529987d2c2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] HTTP exception thrown: Instance 15951a8f-0c58-442e-92b4-7e05d00d2929 could not be found. Jun 15 14:54:43.489291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-97d9ae1a-8318-41d6-8976-86529987d2c2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Request method failure captured: Jun 15 14:54:43.489291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: request: GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 HTTP/1.1 Jun 15 14:54:43.489291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept: application/json Jun 15 14:54:43.489291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept-Encoding: identity Jun 15 14:54:43.489291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Connection: close Jun 15 14:54:43.489291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Length: 0 Jun 15 14:54:43.489291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Type: application/json Jun 15 14:54:43.489291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Host: 10.222.0.57 Jun 15 14:54:43.489291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Openstack-System-Scope: None Jun 15 14:54:43.489291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: User-Agent: python-urllib3/1.26.9 Jun 15 14:54:43.489291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Auth-Token: gAAAAABiqfGtA81J1G_x2ff3wIk9WNt3QYmnBm26jR3C1Gs2is-P7wpJkQsDSBdU7d-N9JTLRxl70QNiPGwIBDR5YY-rvbFUD77VY73Ns036wSG64JihGQQVBXgVpi8TCxZ4jrtMxLvpDXwplGMkMYm1p0WTNbEoOI9C6x7l5c7PYtxIYCxejUU Jun 15 14:54:43.489291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Id: None Jun 15 14:54:43.489291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Name: None Jun 15 14:54:43.489291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Identity-Status: Confirmed Jun 15 14:54:43.489291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Is-Admin-Project: True Jun 15 14:54:43.489291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Id: default Jun 15 14:54:43.489291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Name: Default Jun 15 14:54:43.489291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:54:43.489291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:54:43.489291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Role: member,reader Jun 15 14:54:43.489291 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Roles: member,reader Jun 15 14:54:43.490870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_591d111357224477998b265d45e3ee0d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/591d111357224477998b265d45e3ee0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:54:43.490870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:54:43.490870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:54:43.490870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:54:43.490870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:54:43.490870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Id: default Jun 15 14:54:43.490870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Name: Default Jun 15 14:54:43.490870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Id: 6caa64aecb914e968d057b6b593f667f Jun 15 14:54:43.490870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Name: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:54:43.490870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: method: > Jun 15 14:54:43.490870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: exception: Instance 15951a8f-0c58-442e-92b4-7e05d00d2929 could not be found. Jun 15 14:54:43.490870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: action_args: {'id': '15951a8f-0c58-442e-92b4-7e05d00d2929'} Jun 15 14:54:43.491761 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:54:43.491761 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:43.491761 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:54:43.491761 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:54:43.491761 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:54:43.491761 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:54:43.491761 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:54:43.491761 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:54:43.491761 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:54:43.491761 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:54:43.491761 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15951a8f-0c58-442e-92b4-7e05d00d2929 could not be found. Jun 15 14:54:43.491761 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:54:43.491761 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:54:43.491761 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:54:43.491761 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:43.491761 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:54:43.491761 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:54:43.491761 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:54:43.491761 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:54:43.491761 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:54:43.493374 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:54:43.493374 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:54:43.493374 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:54:43.493374 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:54:43.493374 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:54:43.493374 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:54:43.493374 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:54:43.493374 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15951a8f-0c58-442e-92b4-7e05d00d2929 could not be found. Jun 15 14:54:43.493374 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:54:43.493374 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:54:43.493374 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:54:43.493374 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:43.493374 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:54:43.493374 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:54:43.493374 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:54:43.493374 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:54:43.493374 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15951a8f-0c58-442e-92b4-7e05d00d2929 could not be found. Jun 15 14:54:43.493374 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:54:43.495115 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-97d9ae1a-8318-41d6-8976-86529987d2c2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Returning 404 to user: Instance 15951a8f-0c58-442e-92b4-7e05d00d2929 could not be found. {{(pid=124220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:54:43.495115 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-97d9ae1a-8318-41d6-8976-86529987d2c2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929" status: 404 len: 111 microversion: 2.1 time: 0.035021 Jun 15 14:54:43.495115 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 571/1170] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:43 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:54:43.500985 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f71f42a8-d18e-41b9-88e5-11bdb9f3e0d9 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '.version_select at 0x7f8f20222700>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:43.519025 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f71f42a8-d18e-41b9-88e5-11bdb9f3e0d9 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1418146719" status: 202 len: 0 microversion: 2.1 time: 0.023041 Jun 15 14:54:43.519596 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 600/1171] 10.222.0.57 () {58 vars in 1220 bytes} [Wed Jun 15 14:54:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1418146719 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:54:44.120984 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-36fece47-15ba-4019-a27d-cd2a23a4885d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Action: 'create', calling method: .version_select at 0x7f8f136fc940>, body: {"keypair": {"name": "tempest-keypair-483238921", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJet1zX9uTX508mj6TTL3Tb7C7bMA+pXWChwXvMn60ozDOpcSspYV76Ee8UthFGhNB7veo/FLQ4MS/gKIQcsMgFdYpag/oidakzBY0d8bV9X5fx4iU9vhh1Q48jSnEieQ=="}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:44.135700 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-36fece47-15ba-4019-a27d-cd2a23a4885d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Getting quotas for project 591d111357224477998b265d45e3ee0d. Resources: {'key_pairs'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:54:44.139472 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.quota [None req-36fece47-15ba-4019-a27d-cd2a23a4885d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Getting quotas for user 6caa64aecb914e968d057b6b593f667f and project 591d111357224477998b265d45e3ee0d. Resources: {'key_pairs'} {{(pid=124220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:54:44.161134 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-36fece47-15ba-4019-a27d-cd2a23a4885d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044789 Jun 15 14:54:44.161745 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 572/1172] 10.222.0.57 () {60 vars in 1158 bytes} [Wed Jun 15 14:54:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:54:45.413927 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-bbad5c78-990d-4d9b-9e6c-6019e45c2574 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1384570015", "imageRef": "e18802bf-9dac-462c-88ba-5cce79043279", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ffec14f9-f069-4e9d-93e1-f0addcf3eda2"}], "security_groups": [{"name": "tempest-securitygroup--1097507315"}], "key_name": "tempest-keypair-483238921", "user_data": "}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:45.578809 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.network.neutron [None req-bbad5c78-990d-4d9b-9e6c-6019e45c2574 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] validate_networks() for [('ffec14f9-f069-4e9d-93e1-f0addcf3eda2', None, None, None, None, None)] {{(pid=124219) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:54:46.675715 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-bbad5c78-990d-4d9b-9e6c-6019e45c2574 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Flavor limits 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:54:46.676237 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-bbad5c78-990d-4d9b-9e6c-6019e45c2574 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Image limits 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:54:46.676794 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-bbad5c78-990d-4d9b-9e6c-6019e45c2574 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Flavor pref 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:54:46.677289 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-bbad5c78-990d-4d9b-9e6c-6019e45c2574 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Image pref 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:54:46.677988 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-bbad5c78-990d-4d9b-9e6c-6019e45c2574 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:54:46.687514 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bbad5c78-990d-4d9b-9e6c-6019e45c2574 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:46.688093 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bbad5c78-990d-4d9b-9e6c-6019e45c2574 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:46.688897 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bbad5c78-990d-4d9b-9e6c-6019e45c2574 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:46.689365 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-bbad5c78-990d-4d9b-9e6c-6019e45c2574 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:46.709423 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-bbad5c78-990d-4d9b-9e6c-6019e45c2574 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Getting quotas for project 591d111357224477998b265d45e3ee0d. Resources: {'cores', 'instances', 'ram'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:54:46.714089 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-bbad5c78-990d-4d9b-9e6c-6019e45c2574 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Getting quotas for user 6caa64aecb914e968d057b6b593f667f and project 591d111357224477998b265d45e3ee0d. Resources: {'cores', 'instances', 'ram'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:54:46.725407 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-bbad5c78-990d-4d9b-9e6c-6019e45c2574 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Going to run 1 instances... {{(pid=124219) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:54:46.727755 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-bbad5c78-990d-4d9b-9e6c-6019e45c2574 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e18802bf-9dac-462c-88ba-5cce79043279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124219) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:54:46.775283 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-bbad5c78-990d-4d9b-9e6c-6019e45c2574 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.366151 Jun 15 14:54:46.775959 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 601/1173] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 14:54:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 1367 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:54:46.786189 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-f9916ab1-7aa1-4aa2-bf7c-c01bb0db5e5e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:46.787394 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-f9916ab1-7aa1-4aa2-bf7c-c01bb0db5e5e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:46.867136 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3387d05e-dc3c-41bb-8603-ddf082ce7118 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:46.868270 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-3387d05e-dc3c-41bb-8603-ddf082ce7118 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:46.875006 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3387d05e-dc3c-41bb-8603-ddf082ce7118 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:46.875464 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3387d05e-dc3c-41bb-8603-ddf082ce7118 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:46.876419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3387d05e-dc3c-41bb-8603-ddf082ce7118 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:46.876869 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3387d05e-dc3c-41bb-8603-ddf082ce7118 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:46.878133 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-f9916ab1-7aa1-4aa2-bf7c-c01bb0db5e5e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:46.885866 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-f9916ab1-7aa1-4aa2-bf7c-c01bb0db5e5e tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965" status: 200 len: 1241 microversion: 2.1 time: 0.103832 Jun 15 14:54:46.886836 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 573/1174] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:46 2022] GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 => generated 1241 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:54:46.913412 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-3387d05e-dc3c-41bb-8603-ddf082ce7118 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Going to try to terminate instance {{(pid=124219) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:54:46.976126 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-60c2db2b-6ef0-4b26-9c0d-809059fcf5d3 req-4a52ffe3-76a9-4d9d-8c07-dccc3b3ed291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10953e11-9e61-4fc0-8510-b8148a57dbea", "tag": "284def59-b3d2-48aa-878f-a16bd6b88750"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:46.993679 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-60c2db2b-6ef0-4b26-9c0d-809059fcf5d3 req-4a52ffe3-76a9-4d9d-8c07-dccc3b3ed291 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:47.003490 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-3387d05e-dc3c-41bb-8603-ddf082ce7118 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "DELETE /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea" status: 204 len: 0 microversion: 2.1 time: 0.139819 Jun 15 14:54:47.004508 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 602/1175] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:54:46 2022] DELETE /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 14:54:47.008908 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-60c2db2b-6ef0-4b26-9c0d-809059fcf5d3 req-4a52ffe3-76a9-4d9d-8c07-dccc3b3ed291 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:47.016949 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f3e58943-ccca-427b-9bc0-75b7752dfe05 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:47.017681 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f3e58943-ccca-427b-9bc0-75b7752dfe05 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:47.032816 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f3e58943-ccca-427b-9bc0-75b7752dfe05 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:47.033296 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f3e58943-ccca-427b-9bc0-75b7752dfe05 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:47.034107 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f3e58943-ccca-427b-9bc0-75b7752dfe05 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:47.034552 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f3e58943-ccca-427b-9bc0-75b7752dfe05 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:47.038486 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-60c2db2b-6ef0-4b26-9c0d-809059fcf5d3 req-4a52ffe3-76a9-4d9d-8c07-dccc3b3ed291 service nova] Creating event network-changed:284def59-b3d2-48aa-878f-a16bd6b88750 for instance 10953e11-9e61-4fc0-8510-b8148a57dbea on hv-cinder-84327 Jun 15 14:54:47.045217 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-60c2db2b-6ef0-4b26-9c0d-809059fcf5d3 req-4a52ffe3-76a9-4d9d-8c07-dccc3b3ed291 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156976 Jun 15 14:54:47.046434 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 574/1176] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:54:47.184012 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-f3e58943-ccca-427b-9bc0-75b7752dfe05 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:47.192187 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f3e58943-ccca-427b-9bc0-75b7752dfe05 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea" status: 200 len: 1578 microversion: 2.1 time: 0.179402 Jun 15 14:54:47.192841 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 603/1177] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:47 2022] GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea => generated 1578 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:47.904381 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-fde43295-61ff-4082-84bc-e79bcf7d5770 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:47.905224 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-fde43295-61ff-4082-84bc-e79bcf7d5770 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:47.911883 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fde43295-61ff-4082-84bc-e79bcf7d5770 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:47.912329 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fde43295-61ff-4082-84bc-e79bcf7d5770 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:47.913084 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fde43295-61ff-4082-84bc-e79bcf7d5770 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:47.913515 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fde43295-61ff-4082-84bc-e79bcf7d5770 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:47.979168 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-fde43295-61ff-4082-84bc-e79bcf7d5770 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:47.987140 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-fde43295-61ff-4082-84bc-e79bcf7d5770 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965" status: 200 len: 1245 microversion: 2.1 time: 0.087258 Jun 15 14:54:47.987751 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 575/1178] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:47 2022] GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:48.211015 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-d9e1f4f1-d840-4114-8dbf-a0b11041df3a tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:48.212157 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-d9e1f4f1-d840-4114-8dbf-a0b11041df3a tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:48.218710 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d9e1f4f1-d840-4114-8dbf-a0b11041df3a tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:48.219097 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d9e1f4f1-d840-4114-8dbf-a0b11041df3a tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:48.219864 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d9e1f4f1-d840-4114-8dbf-a0b11041df3a tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:48.220304 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d9e1f4f1-d840-4114-8dbf-a0b11041df3a tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:48.356573 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d9e1f4f1-d840-4114-8dbf-a0b11041df3a tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:48.364389 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-d9e1f4f1-d840-4114-8dbf-a0b11041df3a tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea" status: 200 len: 1578 microversion: 2.1 time: 0.157329 Jun 15 14:54:48.364980 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 604/1179] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:48 2022] GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:49.003829 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6b38b374-1892-4480-bffa-b873657385f2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:49.004451 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6b38b374-1892-4480-bffa-b873657385f2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:49.011163 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6b38b374-1892-4480-bffa-b873657385f2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:49.011553 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6b38b374-1892-4480-bffa-b873657385f2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:49.012320 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6b38b374-1892-4480-bffa-b873657385f2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:49.012759 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6b38b374-1892-4480-bffa-b873657385f2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:49.080077 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-6b38b374-1892-4480-bffa-b873657385f2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:49.089330 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-6b38b374-1892-4480-bffa-b873657385f2 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965" status: 200 len: 1293 microversion: 2.1 time: 0.089323 Jun 15 14:54:49.089931 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 576/1180] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:48 2022] GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:49.382045 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-26511a59-410c-4f79-8ed8-1baaa25fe75d tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:49.383442 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-26511a59-410c-4f79-8ed8-1baaa25fe75d tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:49.392454 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-26511a59-410c-4f79-8ed8-1baaa25fe75d tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:49.393170 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-26511a59-410c-4f79-8ed8-1baaa25fe75d tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:49.394290 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-26511a59-410c-4f79-8ed8-1baaa25fe75d tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:49.394955 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-26511a59-410c-4f79-8ed8-1baaa25fe75d tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:49.721258 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-26511a59-410c-4f79-8ed8-1baaa25fe75d tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:49.729743 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-26511a59-410c-4f79-8ed8-1baaa25fe75d tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea" status: 200 len: 1578 microversion: 2.1 time: 0.351430 Jun 15 14:54:49.730311 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 605/1181] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:49 2022] GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea => generated 1578 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:50.107904 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-72f4e10c-37e2-400b-841f-df570596831c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:50.108559 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-72f4e10c-37e2-400b-841f-df570596831c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:50.116017 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-72f4e10c-37e2-400b-841f-df570596831c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:50.117881 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-72f4e10c-37e2-400b-841f-df570596831c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:50.119030 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-72f4e10c-37e2-400b-841f-df570596831c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:50.119475 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-72f4e10c-37e2-400b-841f-df570596831c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:50.183623 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-f995c340-d4b1-4a1f-9d20-cde7af12e41e req-540ca437-a03f-41ef-9a07-ef35e1b87dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10953e11-9e61-4fc0-8510-b8148a57dbea", "name": "network-vif-deleted", "tag": "284def59-b3d2-48aa-878f-a16bd6b88750"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:50.186346 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-72f4e10c-37e2-400b-841f-df570596831c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:50.198319 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-f995c340-d4b1-4a1f-9d20-cde7af12e41e req-540ca437-a03f-41ef-9a07-ef35e1b87dc2 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:50.198860 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-f995c340-d4b1-4a1f-9d20-cde7af12e41e req-540ca437-a03f-41ef-9a07-ef35e1b87dc2 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:50.198983 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-72f4e10c-37e2-400b-841f-df570596831c tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965" status: 200 len: 1299 microversion: 2.1 time: 0.094152 Jun 15 14:54:50.199606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 577/1182] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:50 2022] GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:50.210647 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-f995c340-d4b1-4a1f-9d20-cde7af12e41e req-540ca437-a03f-41ef-9a07-ef35e1b87dc2 service nova] Creating event network-vif-deleted:284def59-b3d2-48aa-878f-a16bd6b88750 for instance 10953e11-9e61-4fc0-8510-b8148a57dbea on hv-cinder-84327 Jun 15 14:54:50.216075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-f995c340-d4b1-4a1f-9d20-cde7af12e41e req-540ca437-a03f-41ef-9a07-ef35e1b87dc2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037643 Jun 15 14:54:50.217112 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 606/1183] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:54:50.748453 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-66d23081-0811-43b7-b5d4-2597d6361dd6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:50.749078 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-66d23081-0811-43b7-b5d4-2597d6361dd6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:50.755221 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-66d23081-0811-43b7-b5d4-2597d6361dd6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:50.755705 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-66d23081-0811-43b7-b5d4-2597d6361dd6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:50.756636 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-66d23081-0811-43b7-b5d4-2597d6361dd6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:50.757123 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-66d23081-0811-43b7-b5d4-2597d6361dd6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:50.788607 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-66d23081-0811-43b7-b5d4-2597d6361dd6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:50.789091 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-66d23081-0811-43b7-b5d4-2597d6361dd6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:50.789545 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.objects.instance [None req-66d23081-0811-43b7-b5d4-2597d6361dd6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lazy-loading 'fault' on Instance uuid 10953e11-9e61-4fc0-8510-b8148a57dbea {{(pid=124220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:54:50.852881 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-66d23081-0811-43b7-b5d4-2597d6361dd6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:50.862479 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-66d23081-0811-43b7-b5d4-2597d6361dd6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea" status: 200 len: 1231 microversion: 2.1 time: 0.118384 Jun 15 14:54:50.863249 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 578/1184] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:50 2022] GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea => generated 1231 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:51.217355 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-425bd6d2-f945-4123-bbf7-4d1cc6385b76 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:51.218108 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-425bd6d2-f945-4123-bbf7-4d1cc6385b76 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:51.224916 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-425bd6d2-f945-4123-bbf7-4d1cc6385b76 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:51.225372 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-425bd6d2-f945-4123-bbf7-4d1cc6385b76 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:51.226187 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-425bd6d2-f945-4123-bbf7-4d1cc6385b76 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:51.227288 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-425bd6d2-f945-4123-bbf7-4d1cc6385b76 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:51.445589 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-425bd6d2-f945-4123-bbf7-4d1cc6385b76 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:51.455993 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-425bd6d2-f945-4123-bbf7-4d1cc6385b76 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965" status: 200 len: 1367 microversion: 2.1 time: 0.243016 Jun 15 14:54:51.456770 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 607/1185] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:51 2022] GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:51.881808 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-86094ed4-740f-4e24-bee4-0f40464c38f6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:51.882439 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-86094ed4-740f-4e24-bee4-0f40464c38f6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 10953e11-9e61-4fc0-8510-b8148a57dbea] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:51.889771 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-86094ed4-740f-4e24-bee4-0f40464c38f6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:51.890252 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-86094ed4-740f-4e24-bee4-0f40464c38f6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:51.891065 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-86094ed4-740f-4e24-bee4-0f40464c38f6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:51.891561 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-86094ed4-740f-4e24-bee4-0f40464c38f6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:51.905987 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.wsgi [None req-86094ed4-740f-4e24-bee4-0f40464c38f6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] HTTP exception thrown: Instance 10953e11-9e61-4fc0-8510-b8148a57dbea could not be found. Jun 15 14:54:51.907758 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-86094ed4-740f-4e24-bee4-0f40464c38f6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Request method failure captured: Jun 15 14:54:51.907758 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: request: GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea HTTP/1.1 Jun 15 14:54:51.907758 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept: application/json Jun 15 14:54:51.907758 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept-Encoding: identity Jun 15 14:54:51.907758 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Connection: close Jun 15 14:54:51.907758 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Length: 0 Jun 15 14:54:51.907758 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Type: application/json Jun 15 14:54:51.907758 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Host: 10.222.0.57 Jun 15 14:54:51.907758 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Openstack-System-Scope: None Jun 15 14:54:51.907758 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: User-Agent: python-urllib3/1.26.9 Jun 15 14:54:51.907758 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Auth-Token: gAAAAABiqfCm032uWqqc3qLuILnOfrclWfNJ6FPVx3z6BSvdFLc1_kayD56WiDbC6eaDQEVya7DxxzvsZcfxfV1635zr_H1y_QTNvMAtsyBZogQj6qxW6aiFRVRGiOUFYW1vD2u-3grRXuk8o1BP68x5v9gc2IKSZk90rzp7xBUV-Db9UjgjI2c Jun 15 14:54:51.907758 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Id: None Jun 15 14:54:51.907758 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Name: None Jun 15 14:54:51.907758 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Identity-Status: Confirmed Jun 15 14:54:51.907758 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Is-Admin-Project: True Jun 15 14:54:51.907758 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Id: default Jun 15 14:54:51.907758 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Name: Default Jun 15 14:54:51.907758 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Id: 2350f7b62a7d4d8199faf8b18b2ca8dc Jun 15 14:54:51.907758 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Name: tempest-TestVolumeBootPattern-1812848035 Jun 15 14:54:51.907758 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Role: member,reader Jun 15 14:54:51.907758 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Roles: member,reader Jun 15 14:54:51.909399 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2350f7b62a7d4d8199faf8b18b2ca8dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2350f7b62a7d4d8199faf8b18b2ca8dc", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2350f7b62a7d4d8199faf8b18b2ca8dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2350f7b62a7d4d8199faf8b18b2ca8dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:54:51.909399 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant: tempest-TestVolumeBootPattern-1812848035 Jun 15 14:54:51.909399 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Id: 2350f7b62a7d4d8199faf8b18b2ca8dc Jun 15 14:54:51.909399 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Name: tempest-TestVolumeBootPattern-1812848035 Jun 15 14:54:51.909399 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User: tempest-TestVolumeBootPattern-1812848035-project Jun 15 14:54:51.909399 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Id: default Jun 15 14:54:51.909399 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Name: Default Jun 15 14:54:51.909399 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Id: 67d64cad336c44d28c9cf31fc9896854 Jun 15 14:54:51.909399 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Name: tempest-TestVolumeBootPattern-1812848035-project Jun 15 14:54:51.909399 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: method: > Jun 15 14:54:51.909399 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: exception: Instance 10953e11-9e61-4fc0-8510-b8148a57dbea could not be found. Jun 15 14:54:51.909399 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: action_args: {'id': '10953e11-9e61-4fc0-8510-b8148a57dbea'} Jun 15 14:54:51.910518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:54:51.910518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:51.910518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:54:51.910518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:54:51.910518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:54:51.910518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:54:51.910518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:54:51.910518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:54:51.910518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:54:51.910518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:54:51.910518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10953e11-9e61-4fc0-8510-b8148a57dbea could not be found. Jun 15 14:54:51.910518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:54:51.910518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:54:51.910518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:54:51.910518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:51.910518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:54:51.910518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:54:51.910518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:54:51.910518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:54:51.910518 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:54:51.912052 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:54:51.912052 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:54:51.912052 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:54:51.912052 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:54:51.912052 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:54:51.912052 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:54:51.912052 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:54:51.912052 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10953e11-9e61-4fc0-8510-b8148a57dbea could not be found. Jun 15 14:54:51.912052 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:54:51.912052 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:54:51.912052 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:54:51.912052 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:51.912052 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:54:51.912052 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:54:51.912052 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:54:51.912052 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:54:51.912052 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10953e11-9e61-4fc0-8510-b8148a57dbea could not be found. Jun 15 14:54:51.912052 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:54:51.913467 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-86094ed4-740f-4e24-bee4-0f40464c38f6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Returning 404 to user: Instance 10953e11-9e61-4fc0-8510-b8148a57dbea could not be found. {{(pid=124220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:54:51.913467 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-86094ed4-740f-4e24-bee4-0f40464c38f6 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea" status: 404 len: 111 microversion: 2.1 time: 0.031385 Jun 15 14:54:51.913467 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 579/1186] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:51 2022] GET /compute/v2.1/servers/10953e11-9e61-4fc0-8510-b8148a57dbea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:54:52.232546 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-04385f16-da93-4c64-8a25-8d780c36b41f req-daa62afe-6853-44a5-a1d7-41024a9bc7c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965", "tag": "d5dc522d-c7a3-41d1-8712-272937164269"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:52.241843 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-04385f16-da93-4c64-8a25-8d780c36b41f req-daa62afe-6853-44a5-a1d7-41024a9bc7c0 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:52.243105 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-04385f16-da93-4c64-8a25-8d780c36b41f req-daa62afe-6853-44a5-a1d7-41024a9bc7c0 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:52.255955 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-04385f16-da93-4c64-8a25-8d780c36b41f req-daa62afe-6853-44a5-a1d7-41024a9bc7c0 service nova] Creating event network-changed:d5dc522d-c7a3-41d1-8712-272937164269 for instance 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 on hv-cinder-84327 Jun 15 14:54:52.261844 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-04385f16-da93-4c64-8a25-8d780c36b41f req-daa62afe-6853-44a5-a1d7-41024a9bc7c0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032790 Jun 15 14:54:52.262522 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 608/1187] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:54:52.473627 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-ea55a18a-4a13-491c-91cd-fefe0f027e8f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:52.474219 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-ea55a18a-4a13-491c-91cd-fefe0f027e8f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:52.480929 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ea55a18a-4a13-491c-91cd-fefe0f027e8f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:52.481379 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ea55a18a-4a13-491c-91cd-fefe0f027e8f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:52.482168 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ea55a18a-4a13-491c-91cd-fefe0f027e8f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:52.482609 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ea55a18a-4a13-491c-91cd-fefe0f027e8f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:52.611801 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-ea55a18a-4a13-491c-91cd-fefe0f027e8f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:52.620045 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-ea55a18a-4a13-491c-91cd-fefe0f027e8f tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965" status: 200 len: 1367 microversion: 2.1 time: 0.150427 Jun 15 14:54:52.620637 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 580/1188] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:52 2022] GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:53.638619 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-11991a46-b64d-4bc2-adc9-52c3486e9782 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:53.639356 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-11991a46-b64d-4bc2-adc9-52c3486e9782 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:53.645793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-11991a46-b64d-4bc2-adc9-52c3486e9782 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:53.646240 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-11991a46-b64d-4bc2-adc9-52c3486e9782 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:53.646998 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-11991a46-b64d-4bc2-adc9-52c3486e9782 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:53.647434 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-11991a46-b64d-4bc2-adc9-52c3486e9782 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:53.665024 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:53.781085 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-11991a46-b64d-4bc2-adc9-52c3486e9782 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:53.788517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-11991a46-b64d-4bc2-adc9-52c3486e9782 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965" status: 200 len: 1367 microversion: 2.1 time: 0.155910 Jun 15 14:54:53.789094 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 609/1189] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:53 2022] GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:54.806216 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a4b5cc8e-22fa-4f51-9db4-f7b3e4a97412 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:54.807035 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a4b5cc8e-22fa-4f51-9db4-f7b3e4a97412 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:54.813322 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a4b5cc8e-22fa-4f51-9db4-f7b3e4a97412 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:54.813809 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a4b5cc8e-22fa-4f51-9db4-f7b3e4a97412 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:54.814618 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a4b5cc8e-22fa-4f51-9db4-f7b3e4a97412 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:54.815051 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a4b5cc8e-22fa-4f51-9db4-f7b3e4a97412 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:55.047243 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-a4b5cc8e-22fa-4f51-9db4-f7b3e4a97412 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:55.059973 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-ee205810-3937-48c4-8d48-0c50e8494586 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:55.060511 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-ee205810-3937-48c4-8d48-0c50e8494586 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:55.066176 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a4b5cc8e-22fa-4f51-9db4-f7b3e4a97412 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965" status: 200 len: 1367 microversion: 2.1 time: 0.263871 Jun 15 14:54:55.066952 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 581/1190] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:54 2022] GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:55.071384 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-943acf42-9007-4524-98ff-3013ad89f3db req-c6cd7875-b802-4086-975f-e1719b4dea25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef2057b-c064-4900-a338-f86a4383746f", "tag": "a2b93273-5f17-40f1-81a6-00e33227d97a"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:55.077071 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ee205810-3937-48c4-8d48-0c50e8494586 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:55.077579 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ee205810-3937-48c4-8d48-0c50e8494586 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:55.078471 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ee205810-3937-48c4-8d48-0c50e8494586 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:55.078920 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ee205810-3937-48c4-8d48-0c50e8494586 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:55.080224 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-943acf42-9007-4524-98ff-3013ad89f3db req-c6cd7875-b802-4086-975f-e1719b4dea25 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:55.080680 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-943acf42-9007-4524-98ff-3013ad89f3db req-c6cd7875-b802-4086-975f-e1719b4dea25 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:55.093727 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-943acf42-9007-4524-98ff-3013ad89f3db req-c6cd7875-b802-4086-975f-e1719b4dea25 service nova] Creating event network-changed:a2b93273-5f17-40f1-81a6-00e33227d97a for instance 6ef2057b-c064-4900-a338-f86a4383746f on hv-cinder-84327 Jun 15 14:54:55.098749 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-943acf42-9007-4524-98ff-3013ad89f3db req-c6cd7875-b802-4086-975f-e1719b4dea25 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030802 Jun 15 14:54:55.099341 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 582/1191] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:54:55.107326 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-ee205810-3937-48c4-8d48-0c50e8494586 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Going to try to terminate instance {{(pid=124219) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:54:55.197301 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-ee205810-3937-48c4-8d48-0c50e8494586 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 204 len: 0 microversion: 2.1 time: 0.141427 Jun 15 14:54:55.202029 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 610/1192] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:54:55 2022] DELETE /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:54:55.207990 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-aa084fc6-a488-43de-929f-8436b6e45155 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:55.208758 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-aa084fc6-a488-43de-929f-8436b6e45155 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:55.216017 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-aa084fc6-a488-43de-929f-8436b6e45155 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:55.216508 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-aa084fc6-a488-43de-929f-8436b6e45155 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:55.217354 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-aa084fc6-a488-43de-929f-8436b6e45155 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:55.217848 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-aa084fc6-a488-43de-929f-8436b6e45155 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:55.364570 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-aa084fc6-a488-43de-929f-8436b6e45155 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:55.372726 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-aa084fc6-a488-43de-929f-8436b6e45155 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 200 len: 1577 microversion: 2.1 time: 0.169126 Jun 15 14:54:55.373305 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 583/1193] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:55 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:56.084770 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-78c5c352-47e9-4fc7-b86d-8bb87951c349 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:56.085479 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-78c5c352-47e9-4fc7-b86d-8bb87951c349 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:56.092533 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-78c5c352-47e9-4fc7-b86d-8bb87951c349 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:56.092987 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-78c5c352-47e9-4fc7-b86d-8bb87951c349 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:56.093792 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-78c5c352-47e9-4fc7-b86d-8bb87951c349 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:56.094234 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-78c5c352-47e9-4fc7-b86d-8bb87951c349 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:56.238238 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-78c5c352-47e9-4fc7-b86d-8bb87951c349 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:56.245845 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-78c5c352-47e9-4fc7-b86d-8bb87951c349 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965" status: 200 len: 1367 microversion: 2.1 time: 0.165325 Jun 15 14:54:56.246420 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 611/1194] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:56 2022] GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:56.390737 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-4a59dba3-df05-421e-b849-4764fb92e457 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:56.391350 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-4a59dba3-df05-421e-b849-4764fb92e457 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:56.397715 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4a59dba3-df05-421e-b849-4764fb92e457 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:56.398159 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4a59dba3-df05-421e-b849-4764fb92e457 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:56.398909 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4a59dba3-df05-421e-b849-4764fb92e457 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:56.399348 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4a59dba3-df05-421e-b849-4764fb92e457 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:56.530585 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-4a59dba3-df05-421e-b849-4764fb92e457 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:56.538279 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-4a59dba3-df05-421e-b849-4764fb92e457 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 200 len: 1577 microversion: 2.1 time: 0.151377 Jun 15 14:54:56.538853 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 584/1195] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:56 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:57.262666 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-d9b0af40-29e3-4e43-9f0a-075865f0465d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:57.263385 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-d9b0af40-29e3-4e43-9f0a-075865f0465d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:57.265415 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=2 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:57.266484 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=6 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:57.273290 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d9b0af40-29e3-4e43-9f0a-075865f0465d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:57.273764 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d9b0af40-29e3-4e43-9f0a-075865f0465d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:57.274546 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d9b0af40-29e3-4e43-9f0a-075865f0465d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:57.274988 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d9b0af40-29e3-4e43-9f0a-075865f0465d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:57.556438 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-17a4b61c-3dc2-4697-b986-1479e37c1068 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:57.557605 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-17a4b61c-3dc2-4697-b986-1479e37c1068 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:57.559666 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=6 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:57.565899 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-17a4b61c-3dc2-4697-b986-1479e37c1068 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:57.566357 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-17a4b61c-3dc2-4697-b986-1479e37c1068 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:57.567135 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-17a4b61c-3dc2-4697-b986-1479e37c1068 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:57.567573 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-17a4b61c-3dc2-4697-b986-1479e37c1068 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:57.571963 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:57.732140 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-17a4b61c-3dc2-4697-b986-1479e37c1068 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:57.742560 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-17a4b61c-3dc2-4697-b986-1479e37c1068 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 200 len: 1458 microversion: 2.1 time: 0.190013 Jun 15 14:54:57.743136 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 585/1196] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:57 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 1458 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:54:57.769732 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d9b0af40-29e3-4e43-9f0a-075865f0465d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:57.777240 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-d9b0af40-29e3-4e43-9f0a-075865f0465d tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965" status: 200 len: 1367 microversion: 2.1 time: 0.518631 Jun 15 14:54:57.780647 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 612/1197] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:57 2022] GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 => generated 1367 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:57.889970 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-17f150e9-549d-4266-ab79-1f3de3d22055 req-6ef6c5a2-a10b-4327-a540-7f9917ccad90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965", "name": "network-vif-plugged", "status": "completed", "tag": "d5dc522d-c7a3-41d1-8712-272937164269"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:57.898109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-17f150e9-549d-4266-ab79-1f3de3d22055 req-6ef6c5a2-a10b-4327-a540-7f9917ccad90 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:57.898562 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-17f150e9-549d-4266-ab79-1f3de3d22055 req-6ef6c5a2-a10b-4327-a540-7f9917ccad90 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:57.910938 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-17f150e9-549d-4266-ab79-1f3de3d22055 req-6ef6c5a2-a10b-4327-a540-7f9917ccad90 service nova] Creating event network-vif-plugged:d5dc522d-c7a3-41d1-8712-272937164269 for instance 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 on hv-cinder-84327 Jun 15 14:54:57.915693 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-17f150e9-549d-4266-ab79-1f3de3d22055 req-6ef6c5a2-a10b-4327-a540-7f9917ccad90 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091760 Jun 15 14:54:57.916477 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 586/1198] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:54:58.026469 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-b8ba957c-7159-46bd-8e5f-6a7f4bdb324e req-f5c39116-8e33-4f25-9c6a-3db0c692f089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef2057b-c064-4900-a338-f86a4383746f", "name": "network-vif-deleted", "tag": "a2b93273-5f17-40f1-81a6-00e33227d97a"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:58.034865 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-b8ba957c-7159-46bd-8e5f-6a7f4bdb324e req-f5c39116-8e33-4f25-9c6a-3db0c692f089 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:58.035321 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-b8ba957c-7159-46bd-8e5f-6a7f4bdb324e req-f5c39116-8e33-4f25-9c6a-3db0c692f089 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:58.046617 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-b8ba957c-7159-46bd-8e5f-6a7f4bdb324e req-f5c39116-8e33-4f25-9c6a-3db0c692f089 service nova] Creating event network-vif-deleted:a2b93273-5f17-40f1-81a6-00e33227d97a for instance 6ef2057b-c064-4900-a338-f86a4383746f on hv-cinder-84327 Jun 15 14:54:58.052068 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-b8ba957c-7159-46bd-8e5f-6a7f4bdb324e req-f5c39116-8e33-4f25-9c6a-3db0c692f089 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030998 Jun 15 14:54:58.052747 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 613/1199] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:54:58.761022 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-5fa6f866-9738-4722-ad24-c0735305740e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:58.761645 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-5fa6f866-9738-4722-ad24-c0735305740e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:58.763615 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:58.768995 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5fa6f866-9738-4722-ad24-c0735305740e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:58.769443 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5fa6f866-9738-4722-ad24-c0735305740e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:58.770232 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5fa6f866-9738-4722-ad24-c0735305740e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:58.770675 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5fa6f866-9738-4722-ad24-c0735305740e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:58.795651 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-313421b3-ee73-456c-b0cd-c55b7be72356 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:58.796349 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-313421b3-ee73-456c-b0cd-c55b7be72356 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:58.802593 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-313421b3-ee73-456c-b0cd-c55b7be72356 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:58.802742 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5fa6f866-9738-4722-ad24-c0735305740e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:58.803041 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-313421b3-ee73-456c-b0cd-c55b7be72356 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:58.803159 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-5fa6f866-9738-4722-ad24-c0735305740e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:58.803486 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.objects.instance [None req-5fa6f866-9738-4722-ad24-c0735305740e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lazy-loading 'fault' on Instance uuid 6ef2057b-c064-4900-a338-f86a4383746f {{(pid=124220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:54:58.803800 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-313421b3-ee73-456c-b0cd-c55b7be72356 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:58.804234 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-313421b3-ee73-456c-b0cd-c55b7be72356 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:58.844602 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-5fa6f866-9738-4722-ad24-c0735305740e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:58.852278 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-5fa6f866-9738-4722-ad24-c0735305740e tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 200 len: 1230 microversion: 2.1 time: 0.095955 Jun 15 14:54:58.852843 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 587/1200] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:58 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:58.940482 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-313421b3-ee73-456c-b0cd-c55b7be72356 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:58.948035 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-313421b3-ee73-456c-b0cd-c55b7be72356 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965" status: 200 len: 1367 microversion: 2.1 time: 0.157780 Jun 15 14:54:58.948598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 614/1201] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:58 2022] GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:54:59.870173 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-36707d53-a334-4187-8fab-dfda585b1bfc tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:59.871463 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-36707d53-a334-4187-8fab-dfda585b1bfc tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:59.878049 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-36707d53-a334-4187-8fab-dfda585b1bfc tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:59.878501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-36707d53-a334-4187-8fab-dfda585b1bfc tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:59.879264 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-36707d53-a334-4187-8fab-dfda585b1bfc tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:59.879703 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-36707d53-a334-4187-8fab-dfda585b1bfc tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:59.910102 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-36707d53-a334-4187-8fab-dfda585b1bfc tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:59.910546 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-36707d53-a334-4187-8fab-dfda585b1bfc tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:59.910990 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.objects.instance [None req-36707d53-a334-4187-8fab-dfda585b1bfc tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lazy-loading 'fault' on Instance uuid 6ef2057b-c064-4900-a338-f86a4383746f {{(pid=124220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:54:59.951527 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-36707d53-a334-4187-8fab-dfda585b1bfc tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d64cad336c44d28c9cf31fc9896854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2350f7b62a7d4d8199faf8b18b2ca8dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:59.959028 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-36707d53-a334-4187-8fab-dfda585b1bfc tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 200 len: 1230 microversion: 2.1 time: 0.092753 Jun 15 14:54:59.959753 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 588/1202] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:59 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 1230 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:59.964987 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-829454c3-6628-4cb9-ab4e-86031a502466 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:59.966091 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-829454c3-6628-4cb9-ab4e-86031a502466 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:59.968582 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:59.973784 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-829454c3-6628-4cb9-ab4e-86031a502466 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:59.974276 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-829454c3-6628-4cb9-ab4e-86031a502466 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:59.975031 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-829454c3-6628-4cb9-ab4e-86031a502466 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:59.975461 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-829454c3-6628-4cb9-ab4e-86031a502466 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:00.106703 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-829454c3-6628-4cb9-ab4e-86031a502466 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:00.114398 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-829454c3-6628-4cb9-ab4e-86031a502466 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965" status: 200 len: 1558 microversion: 2.1 time: 0.153663 Jun 15 14:55:00.114963 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 615/1203] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:59 2022] GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:55:00.131470 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-ddd2ee21-0740-427c-885b-158f806bafa4 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:00.131898 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-ddd2ee21-0740-427c-885b-158f806bafa4 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:00.138972 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ddd2ee21-0740-427c-885b-158f806bafa4 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:00.139467 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ddd2ee21-0740-427c-885b-158f806bafa4 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:00.140344 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ddd2ee21-0740-427c-885b-158f806bafa4 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:00.140826 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-ddd2ee21-0740-427c-885b-158f806bafa4 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:00.221738 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-ddd2ee21-0740-427c-885b-158f806bafa4 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094073 Jun 15 14:55:00.222434 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 589/1204] 10.222.0.57 () {58 vars in 1274 bytes} [Wed Jun 15 14:55:00 2022] GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:55:00.976000 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-12251eac-1fe4-47e7-b9fb-34f167de4dcc tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:00.976610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-12251eac-1fe4-47e7-b9fb-34f167de4dcc tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 6ef2057b-c064-4900-a338-f86a4383746f] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:00.984816 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-12251eac-1fe4-47e7-b9fb-34f167de4dcc tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:00.985262 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-12251eac-1fe4-47e7-b9fb-34f167de4dcc tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:00.986320 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-12251eac-1fe4-47e7-b9fb-34f167de4dcc tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:00.986753 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-12251eac-1fe4-47e7-b9fb-34f167de4dcc tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:01.000938 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-12251eac-1fe4-47e7-b9fb-34f167de4dcc tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] HTTP exception thrown: Instance 6ef2057b-c064-4900-a338-f86a4383746f could not be found. Jun 15 14:55:01.002610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-12251eac-1fe4-47e7-b9fb-34f167de4dcc tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Request method failure captured: Jun 15 14:55:01.002610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f HTTP/1.1 Jun 15 14:55:01.002610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:55:01.002610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:55:01.002610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:55:01.002610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:55:01.002610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:55:01.002610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:55:01.002610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:55:01.002610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:55:01.002610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfCm032uWqqc3qLuILnOfrclWfNJ6FPVx3z6BSvdFLc1_kayD56WiDbC6eaDQEVya7DxxzvsZcfxfV1635zr_H1y_QTNvMAtsyBZogQj6qxW6aiFRVRGiOUFYW1vD2u-3grRXuk8o1BP68x5v9gc2IKSZk90rzp7xBUV-Db9UjgjI2c Jun 15 14:55:01.002610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:55:01.002610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:55:01.002610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:55:01.002610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:55:01.002610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:55:01.002610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:55:01.002610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 2350f7b62a7d4d8199faf8b18b2ca8dc Jun 15 14:55:01.002610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-TestVolumeBootPattern-1812848035 Jun 15 14:55:01.002610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:55:01.002610 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:55:01.004184 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2350f7b62a7d4d8199faf8b18b2ca8dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2350f7b62a7d4d8199faf8b18b2ca8dc", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2350f7b62a7d4d8199faf8b18b2ca8dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2350f7b62a7d4d8199faf8b18b2ca8dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:55:01.004184 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-TestVolumeBootPattern-1812848035 Jun 15 14:55:01.004184 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 2350f7b62a7d4d8199faf8b18b2ca8dc Jun 15 14:55:01.004184 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-TestVolumeBootPattern-1812848035 Jun 15 14:55:01.004184 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-TestVolumeBootPattern-1812848035-project Jun 15 14:55:01.004184 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:55:01.004184 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:55:01.004184 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 67d64cad336c44d28c9cf31fc9896854 Jun 15 14:55:01.004184 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-TestVolumeBootPattern-1812848035-project Jun 15 14:55:01.004184 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:55:01.004184 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Instance 6ef2057b-c064-4900-a338-f86a4383746f could not be found. Jun 15 14:55:01.004184 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': '6ef2057b-c064-4900-a338-f86a4383746f'} Jun 15 14:55:01.004993 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:55:01.004993 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:01.004993 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:55:01.004993 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:55:01.004993 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:55:01.004993 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:55:01.004993 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:55:01.004993 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:55:01.004993 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:55:01.004993 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:55:01.004993 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef2057b-c064-4900-a338-f86a4383746f could not be found. Jun 15 14:55:01.004993 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:01.004993 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:55:01.004993 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:01.004993 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:01.004993 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:55:01.004993 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:55:01.004993 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:55:01.004993 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:55:01.004993 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:55:01.006370 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:55:01.006370 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:55:01.006370 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:55:01.006370 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:55:01.006370 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:55:01.006370 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:55:01.006370 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:55:01.006370 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef2057b-c064-4900-a338-f86a4383746f could not be found. Jun 15 14:55:01.006370 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:01.006370 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:55:01.006370 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:01.006370 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:01.006370 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:55:01.006370 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:55:01.006370 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:55:01.006370 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:55:01.006370 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef2057b-c064-4900-a338-f86a4383746f could not be found. Jun 15 14:55:01.006370 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:01.007600 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-12251eac-1fe4-47e7-b9fb-34f167de4dcc tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Returning 404 to user: Instance 6ef2057b-c064-4900-a338-f86a4383746f could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:55:01.007600 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-12251eac-1fe4-47e7-b9fb-34f167de4dcc tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f" status: 404 len: 111 microversion: 2.1 time: 0.031940 Jun 15 14:55:01.007600 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 616/1205] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:00 2022] GET /compute/v2.1/servers/6ef2057b-c064-4900-a338-f86a4383746f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:55:01.411703 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-ed3d78f7-3f3a-421b-8632-095927067269 req-660c37b2-ba15-4cc8-9d26-0d195ba66a7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965", "tag": "d5dc522d-c7a3-41d1-8712-272937164269"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:01.420606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-ed3d78f7-3f3a-421b-8632-095927067269 req-660c37b2-ba15-4cc8-9d26-0d195ba66a7a service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:01.421175 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-ed3d78f7-3f3a-421b-8632-095927067269 req-660c37b2-ba15-4cc8-9d26-0d195ba66a7a service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:01.435531 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-ed3d78f7-3f3a-421b-8632-095927067269 req-660c37b2-ba15-4cc8-9d26-0d195ba66a7a service nova] Creating event network-changed:d5dc522d-c7a3-41d1-8712-272937164269 for instance 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 on hv-cinder-84327 Jun 15 14:55:01.441027 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-ed3d78f7-3f3a-421b-8632-095927067269 req-660c37b2-ba15-4cc8-9d26-0d195ba66a7a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033779 Jun 15 14:55:01.442561 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 590/1206] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:55:01.464029 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-6939ee57-23cb-41c6-a06a-7abbfea9e268 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:01.464736 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-6939ee57-23cb-41c6-a06a-7abbfea9e268 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:01.471463 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6939ee57-23cb-41c6-a06a-7abbfea9e268 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:01.471912 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6939ee57-23cb-41c6-a06a-7abbfea9e268 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:01.472678 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6939ee57-23cb-41c6-a06a-7abbfea9e268 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:01.473145 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-6939ee57-23cb-41c6-a06a-7abbfea9e268 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:01.489320 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-6939ee57-23cb-41c6-a06a-7abbfea9e268 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] HTTP exception thrown: Instance 9104e014-d497-460a-8215-6439f0a2e521 could not be found. Jun 15 14:55:01.491075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-6939ee57-23cb-41c6-a06a-7abbfea9e268 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Request method failure captured: Jun 15 14:55:01.491075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: DELETE /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 HTTP/1.1 Jun 15 14:55:01.491075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:55:01.491075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:55:01.491075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:55:01.491075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:55:01.491075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:55:01.491075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:55:01.491075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:55:01.491075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:55:01.491075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfCm032uWqqc3qLuILnOfrclWfNJ6FPVx3z6BSvdFLc1_kayD56WiDbC6eaDQEVya7DxxzvsZcfxfV1635zr_H1y_QTNvMAtsyBZogQj6qxW6aiFRVRGiOUFYW1vD2u-3grRXuk8o1BP68x5v9gc2IKSZk90rzp7xBUV-Db9UjgjI2c Jun 15 14:55:01.491075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:55:01.491075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:55:01.491075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:55:01.491075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:55:01.491075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:55:01.491075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:55:01.491075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 2350f7b62a7d4d8199faf8b18b2ca8dc Jun 15 14:55:01.491075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-TestVolumeBootPattern-1812848035 Jun 15 14:55:01.491075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:55:01.491075 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:55:01.493125 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2350f7b62a7d4d8199faf8b18b2ca8dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2350f7b62a7d4d8199faf8b18b2ca8dc", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2350f7b62a7d4d8199faf8b18b2ca8dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2350f7b62a7d4d8199faf8b18b2ca8dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:55:01.493125 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-TestVolumeBootPattern-1812848035 Jun 15 14:55:01.493125 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 2350f7b62a7d4d8199faf8b18b2ca8dc Jun 15 14:55:01.493125 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-TestVolumeBootPattern-1812848035 Jun 15 14:55:01.493125 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-TestVolumeBootPattern-1812848035-project Jun 15 14:55:01.493125 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:55:01.493125 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:55:01.493125 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 67d64cad336c44d28c9cf31fc9896854 Jun 15 14:55:01.493125 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-TestVolumeBootPattern-1812848035-project Jun 15 14:55:01.493125 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:55:01.493125 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Instance 9104e014-d497-460a-8215-6439f0a2e521 could not be found. Jun 15 14:55:01.493125 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': '9104e014-d497-460a-8215-6439f0a2e521'} Jun 15 14:55:01.494708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:55:01.494708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:01.494708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:55:01.494708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:55:01.494708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:55:01.494708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:55:01.494708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:55:01.494708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:55:01.494708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:55:01.494708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:55:01.494708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9104e014-d497-460a-8215-6439f0a2e521 could not be found. Jun 15 14:55:01.494708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:01.494708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:55:01.494708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:01.494708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:01.494708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:55:01.494708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:55:01.494708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:55:01.494708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:55:01.494708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:55:01.498017 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:55:01.498017 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 14:55:01.498017 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 14:55:01.498017 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 14:55:01.498017 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 14:55:01.498017 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:55:01.498017 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:55:01.498017 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:55:01.498017 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:55:01.498017 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9104e014-d497-460a-8215-6439f0a2e521 could not be found. Jun 15 14:55:01.498017 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:01.498017 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:55:01.498017 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:01.498017 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:01.498017 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:55:01.498017 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:55:01.498017 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:55:01.498017 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:55:01.498017 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9104e014-d497-460a-8215-6439f0a2e521 could not be found. Jun 15 14:55:01.498017 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:01.501124 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-6939ee57-23cb-41c6-a06a-7abbfea9e268 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Returning 404 to user: Instance 9104e014-d497-460a-8215-6439f0a2e521 could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:55:01.501124 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-6939ee57-23cb-41c6-a06a-7abbfea9e268 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 404 len: 111 microversion: 2.1 time: 0.032396 Jun 15 14:55:01.501124 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 617/1207] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:55:01 2022] DELETE /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:55:01.506529 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-f6428058-0cf9-482c-b03a-df6d5981c647 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:01.507419 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-f6428058-0cf9-482c-b03a-df6d5981c647 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] [instance: 9104e014-d497-460a-8215-6439f0a2e521] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:01.515985 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f6428058-0cf9-482c-b03a-df6d5981c647 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:01.516444 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f6428058-0cf9-482c-b03a-df6d5981c647 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:01.517226 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f6428058-0cf9-482c-b03a-df6d5981c647 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:01.517800 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f6428058-0cf9-482c-b03a-df6d5981c647 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:01.545381 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.wsgi [None req-f6428058-0cf9-482c-b03a-df6d5981c647 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] HTTP exception thrown: Instance 9104e014-d497-460a-8215-6439f0a2e521 could not be found. Jun 15 14:55:01.547074 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-f6428058-0cf9-482c-b03a-df6d5981c647 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Request method failure captured: Jun 15 14:55:01.547074 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: request: GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 HTTP/1.1 Jun 15 14:55:01.547074 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept: application/json Jun 15 14:55:01.547074 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept-Encoding: identity Jun 15 14:55:01.547074 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Connection: close Jun 15 14:55:01.547074 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Length: 0 Jun 15 14:55:01.547074 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Type: application/json Jun 15 14:55:01.547074 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Host: 10.222.0.57 Jun 15 14:55:01.547074 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Openstack-System-Scope: None Jun 15 14:55:01.547074 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: User-Agent: python-urllib3/1.26.9 Jun 15 14:55:01.547074 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Auth-Token: gAAAAABiqfCm032uWqqc3qLuILnOfrclWfNJ6FPVx3z6BSvdFLc1_kayD56WiDbC6eaDQEVya7DxxzvsZcfxfV1635zr_H1y_QTNvMAtsyBZogQj6qxW6aiFRVRGiOUFYW1vD2u-3grRXuk8o1BP68x5v9gc2IKSZk90rzp7xBUV-Db9UjgjI2c Jun 15 14:55:01.547074 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Id: None Jun 15 14:55:01.547074 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Name: None Jun 15 14:55:01.547074 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Identity-Status: Confirmed Jun 15 14:55:01.547074 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Is-Admin-Project: True Jun 15 14:55:01.547074 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Id: default Jun 15 14:55:01.547074 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Name: Default Jun 15 14:55:01.547074 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Id: 2350f7b62a7d4d8199faf8b18b2ca8dc Jun 15 14:55:01.547074 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Name: tempest-TestVolumeBootPattern-1812848035 Jun 15 14:55:01.547074 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Role: member,reader Jun 15 14:55:01.547074 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Roles: member,reader Jun 15 14:55:01.548681 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2350f7b62a7d4d8199faf8b18b2ca8dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2350f7b62a7d4d8199faf8b18b2ca8dc", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2350f7b62a7d4d8199faf8b18b2ca8dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2350f7b62a7d4d8199faf8b18b2ca8dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:55:01.548681 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant: tempest-TestVolumeBootPattern-1812848035 Jun 15 14:55:01.548681 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Id: 2350f7b62a7d4d8199faf8b18b2ca8dc Jun 15 14:55:01.548681 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Name: tempest-TestVolumeBootPattern-1812848035 Jun 15 14:55:01.548681 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User: tempest-TestVolumeBootPattern-1812848035-project Jun 15 14:55:01.548681 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Id: default Jun 15 14:55:01.548681 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Name: Default Jun 15 14:55:01.548681 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Id: 67d64cad336c44d28c9cf31fc9896854 Jun 15 14:55:01.548681 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Name: tempest-TestVolumeBootPattern-1812848035-project Jun 15 14:55:01.548681 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: method: > Jun 15 14:55:01.548681 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: exception: Instance 9104e014-d497-460a-8215-6439f0a2e521 could not be found. Jun 15 14:55:01.548681 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: action_args: {'id': '9104e014-d497-460a-8215-6439f0a2e521'} Jun 15 14:55:01.549528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:55:01.549528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:01.549528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:55:01.549528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:55:01.549528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:55:01.549528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:55:01.549528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:55:01.549528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:55:01.549528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:55:01.549528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:55:01.549528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9104e014-d497-460a-8215-6439f0a2e521 could not be found. Jun 15 14:55:01.549528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:55:01.549528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:55:01.549528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:55:01.549528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:01.549528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:55:01.549528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:55:01.549528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:55:01.549528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:55:01.549528 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:55:01.550791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:55:01.550791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:55:01.550791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:55:01.550791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:55:01.550791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:55:01.550791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:55:01.550791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:55:01.550791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9104e014-d497-460a-8215-6439f0a2e521 could not be found. Jun 15 14:55:01.550791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:55:01.550791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:55:01.550791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:55:01.550791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:01.550791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:55:01.550791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:55:01.550791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:55:01.550791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:55:01.550791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9104e014-d497-460a-8215-6439f0a2e521 could not be found. Jun 15 14:55:01.550791 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:55:01.551917 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-f6428058-0cf9-482c-b03a-df6d5981c647 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Returning 404 to user: Instance 9104e014-d497-460a-8215-6439f0a2e521 could not be found. {{(pid=124220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:55:01.551917 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-f6428058-0cf9-482c-b03a-df6d5981c647 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521" status: 404 len: 111 microversion: 2.1 time: 0.048225 Jun 15 14:55:01.551917 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 591/1208] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:01 2022] GET /compute/v2.1/servers/9104e014-d497-460a-8215-6439f0a2e521 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:55:02.876375 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-d77bee23-4d17-48a1-b4f5-21485be85766 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] Calling method '.version_select at 0x7f8f201d3e50>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:02.895752 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-d77bee23-4d17-48a1-b4f5-21485be85766 tempest-TestVolumeBootPattern-1812848035 tempest-TestVolumeBootPattern-1812848035-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1261933231" status: 202 len: 0 microversion: 2.1 time: 0.025146 Jun 15 14:55:02.896331 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 618/1209] 10.222.0.57 () {58 vars in 1262 bytes} [Wed Jun 15 14:55:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1261933231 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:55:37.666090 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=13 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:37.666844 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=30 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:37.931219 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1a6ae7dd-705c-4a08-9952-ce3770dc3949 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:37.931718 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1a6ae7dd-705c-4a08-9952-ce3770dc3949 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:37.937713 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1a6ae7dd-705c-4a08-9952-ce3770dc3949 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:37.938165 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1a6ae7dd-705c-4a08-9952-ce3770dc3949 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:37.938924 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1a6ae7dd-705c-4a08-9952-ce3770dc3949 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:37.939359 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1a6ae7dd-705c-4a08-9952-ce3770dc3949 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:37.962242 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-1a6ae7dd-705c-4a08-9952-ce3770dc3949 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965/ips" status: 200 len: 151 microversion: 2.1 time: 0.301225 Jun 15 14:55:37.962782 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 592/1210] 10.222.0.57 () {58 vars in 1247 bytes} [Wed Jun 15 14:55:37 2022] GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965/ips => generated 151 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:55:39.276422 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:39.277192 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:39.281560 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-cac6bd08-e82f-465e-9e49-a2e1c7b80da3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a18e4ddb-4ddd-437a-83ac-fdf89e557c91"}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:39.282643 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-cac6bd08-e82f-465e-9e49-a2e1c7b80da3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:39.290989 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-cac6bd08-e82f-465e-9e49-a2e1c7b80da3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:39.291485 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-cac6bd08-e82f-465e-9e49-a2e1c7b80da3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:39.292251 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-cac6bd08-e82f-465e-9e49-a2e1c7b80da3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:39.292694 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-cac6bd08-e82f-465e-9e49-a2e1c7b80da3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:39.557182 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-cac6bd08-e82f-465e-9e49-a2e1c7b80da3 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "POST /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282016 Jun 15 14:55:39.557818 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 619/1211] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 14:55:39 2022] POST /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:55:47.152799 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-0bf33e25-9da7-4334-8e46-c383e90a1b26 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:47.153572 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-0bf33e25-9da7-4334-8e46-c383e90a1b26 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:47.160344 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0bf33e25-9da7-4334-8e46-c383e90a1b26 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:47.160788 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0bf33e25-9da7-4334-8e46-c383e90a1b26 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:47.161538 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0bf33e25-9da7-4334-8e46-c383e90a1b26 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:47.161989 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-0bf33e25-9da7-4334-8e46-c383e90a1b26 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:47.243266 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.objects.instance [None req-0bf33e25-9da7-4334-8e46-c383e90a1b26 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lazy-loading 'services' on Instance uuid 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 {{(pid=124220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:55:47.312543 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-0bf33e25-9da7-4334-8e46-c383e90a1b26 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "DELETE /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965/os-volume_attachments/a18e4ddb-4ddd-437a-83ac-fdf89e557c91" status: 202 len: 0 microversion: 2.1 time: 0.163454 Jun 15 14:55:47.313121 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 593/1212] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Jun 15 14:55:47 2022] DELETE /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965/os-volume_attachments/a18e4ddb-4ddd-437a-83ac-fdf89e557c91 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:55:47.322580 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-516d3d7e-c860-4101-8d4b-33f39d46fa81 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:47.324056 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-516d3d7e-c860-4101-8d4b-33f39d46fa81 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:47.331909 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-516d3d7e-c860-4101-8d4b-33f39d46fa81 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:47.332386 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-516d3d7e-c860-4101-8d4b-33f39d46fa81 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:47.333164 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-516d3d7e-c860-4101-8d4b-33f39d46fa81 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:47.333599 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-516d3d7e-c860-4101-8d4b-33f39d46fa81 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:47.365926 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-516d3d7e-c860-4101-8d4b-33f39d46fa81 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048186 Jun 15 14:55:47.366477 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 620/1213] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 14:55:47 2022] GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:55:48.379877 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-33a35fc0-d5a0-463f-ab88-bdffd6577849 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:48.380976 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-33a35fc0-d5a0-463f-ab88-bdffd6577849 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:48.387338 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-33a35fc0-d5a0-463f-ab88-bdffd6577849 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:48.387795 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-33a35fc0-d5a0-463f-ab88-bdffd6577849 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:48.388560 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-33a35fc0-d5a0-463f-ab88-bdffd6577849 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:48.389006 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-33a35fc0-d5a0-463f-ab88-bdffd6577849 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:48.418152 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-33a35fc0-d5a0-463f-ab88-bdffd6577849 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044202 Jun 15 14:55:48.418641 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 594/1214] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 14:55:48 2022] GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 14:55:48.477079 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-ec39147b-d1d7-4d6b-8547-28b799c0f06a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:48.477602 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-ec39147b-d1d7-4d6b-8547-28b799c0f06a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:48.484799 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ec39147b-d1d7-4d6b-8547-28b799c0f06a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:48.485248 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ec39147b-d1d7-4d6b-8547-28b799c0f06a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:48.486037 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ec39147b-d1d7-4d6b-8547-28b799c0f06a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:48.486476 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ec39147b-d1d7-4d6b-8547-28b799c0f06a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:48.512795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-ec39147b-d1d7-4d6b-8547-28b799c0f06a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Going to try to terminate instance {{(pid=124219) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:55:48.585597 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-ec39147b-d1d7-4d6b-8547-28b799c0f06a tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "DELETE /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965" status: 204 len: 0 microversion: 2.1 time: 0.112001 Jun 15 14:55:48.586520 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 621/1215] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:55:48 2022] DELETE /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:55:48.596136 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-162ce70d-c565-4d7a-ae61-7d2478043c24 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:48.596758 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-162ce70d-c565-4d7a-ae61-7d2478043c24 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:48.603207 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-162ce70d-c565-4d7a-ae61-7d2478043c24 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:48.603656 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-162ce70d-c565-4d7a-ae61-7d2478043c24 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:48.604419 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-162ce70d-c565-4d7a-ae61-7d2478043c24 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:48.604857 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-162ce70d-c565-4d7a-ae61-7d2478043c24 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:48.734377 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-162ce70d-c565-4d7a-ae61-7d2478043c24 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:48.742097 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-162ce70d-c565-4d7a-ae61-7d2478043c24 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965" status: 200 len: 1683 microversion: 2.1 time: 0.150506 Jun 15 14:55:48.742664 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 595/1216] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:48 2022] GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:49.759761 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-404ae575-718a-417c-8dc2-2c191fa4a900 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:49.760419 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-404ae575-718a-417c-8dc2-2c191fa4a900 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:49.767005 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-404ae575-718a-417c-8dc2-2c191fa4a900 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:49.767457 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-404ae575-718a-417c-8dc2-2c191fa4a900 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:49.768214 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-404ae575-718a-417c-8dc2-2c191fa4a900 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:49.768652 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-404ae575-718a-417c-8dc2-2c191fa4a900 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:49.898865 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-404ae575-718a-417c-8dc2-2c191fa4a900 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:49.906542 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-404ae575-718a-417c-8dc2-2c191fa4a900 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965" status: 200 len: 1683 microversion: 2.1 time: 0.151037 Jun 15 14:55:49.907107 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 622/1217] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:49 2022] GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:50.924454 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-955be898-a876-484f-8666-8d47792b5d92 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:50.925241 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-955be898-a876-484f-8666-8d47792b5d92 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:50.931988 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-955be898-a876-484f-8666-8d47792b5d92 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:50.932444 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-955be898-a876-484f-8666-8d47792b5d92 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:50.933258 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-955be898-a876-484f-8666-8d47792b5d92 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:50.933720 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-955be898-a876-484f-8666-8d47792b5d92 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:51.072818 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-955be898-a876-484f-8666-8d47792b5d92 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:51.080717 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-955be898-a876-484f-8666-8d47792b5d92 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965" status: 200 len: 1683 microversion: 2.1 time: 0.160774 Jun 15 14:55:51.081307 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 596/1218] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:50 2022] GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:51.613488 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-9b3a0d5f-8dac-4c5f-b5c1-22ed8aba57e8 req-c4887c7e-ca61-4b58-a361-b584a362f449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965", "name": "network-vif-deleted", "tag": "d5dc522d-c7a3-41d1-8712-272937164269"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:51.622352 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-9b3a0d5f-8dac-4c5f-b5c1-22ed8aba57e8 req-c4887c7e-ca61-4b58-a361-b584a362f449 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:51.622864 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-9b3a0d5f-8dac-4c5f-b5c1-22ed8aba57e8 req-c4887c7e-ca61-4b58-a361-b584a362f449 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:51.637004 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-9b3a0d5f-8dac-4c5f-b5c1-22ed8aba57e8 req-c4887c7e-ca61-4b58-a361-b584a362f449 service nova] Creating event network-vif-deleted:d5dc522d-c7a3-41d1-8712-272937164269 for instance 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 on hv-cinder-84327 Jun 15 14:55:51.642794 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-9b3a0d5f-8dac-4c5f-b5c1-22ed8aba57e8 req-c4887c7e-ca61-4b58-a361-b584a362f449 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033128 Jun 15 14:55:51.643633 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 623/1219] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:55:52.098936 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-76d9869a-5cf8-4ec9-bca7-f2b98d1e0085 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:52.099504 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-76d9869a-5cf8-4ec9-bca7-f2b98d1e0085 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:52.106189 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-76d9869a-5cf8-4ec9-bca7-f2b98d1e0085 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:52.106646 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-76d9869a-5cf8-4ec9-bca7-f2b98d1e0085 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:52.107416 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-76d9869a-5cf8-4ec9-bca7-f2b98d1e0085 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:52.107858 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-76d9869a-5cf8-4ec9-bca7-f2b98d1e0085 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:52.140881 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-76d9869a-5cf8-4ec9-bca7-f2b98d1e0085 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:52.141630 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-76d9869a-5cf8-4ec9-bca7-f2b98d1e0085 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:52.142273 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.objects.instance [None req-76d9869a-5cf8-4ec9-bca7-f2b98d1e0085 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lazy-loading 'fault' on Instance uuid 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 {{(pid=124220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:55:52.184442 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-76d9869a-5cf8-4ec9-bca7-f2b98d1e0085 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caa64aecb914e968d057b6b593f667f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591d111357224477998b265d45e3ee0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:52.193442 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-76d9869a-5cf8-4ec9-bca7-f2b98d1e0085 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965" status: 200 len: 1331 microversion: 2.1 time: 0.098436 Jun 15 14:55:52.194758 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 597/1220] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:52 2022] GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:53.212161 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c0b70b80-b7ed-465a-a2f1-4dea215ff716 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:53.212865 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c0b70b80-b7ed-465a-a2f1-4dea215ff716 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:53.219709 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c0b70b80-b7ed-465a-a2f1-4dea215ff716 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:53.220160 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c0b70b80-b7ed-465a-a2f1-4dea215ff716 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:53.220924 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c0b70b80-b7ed-465a-a2f1-4dea215ff716 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:53.221406 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c0b70b80-b7ed-465a-a2f1-4dea215ff716 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:53.235042 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-c0b70b80-b7ed-465a-a2f1-4dea215ff716 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] HTTP exception thrown: Instance 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 could not be found. Jun 15 14:55:53.236668 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c0b70b80-b7ed-465a-a2f1-4dea215ff716 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Request method failure captured: Jun 15 14:55:53.236668 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 HTTP/1.1 Jun 15 14:55:53.236668 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:55:53.236668 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:55:53.236668 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:55:53.236668 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:55:53.236668 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:55:53.236668 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:55:53.236668 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:55:53.236668 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:55:53.236668 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfGtA81J1G_x2ff3wIk9WNt3QYmnBm26jR3C1Gs2is-P7wpJkQsDSBdU7d-N9JTLRxl70QNiPGwIBDR5YY-rvbFUD77VY73Ns036wSG64JihGQQVBXgVpi8TCxZ4jrtMxLvpDXwplGMkMYm1p0WTNbEoOI9C6x7l5c7PYtxIYCxejUU Jun 15 14:55:53.236668 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:55:53.236668 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:55:53.236668 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:55:53.236668 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:55:53.236668 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:55:53.236668 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:55:53.236668 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:55:53.236668 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:53.236668 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:55:53.236668 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:55:53.238710 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_591d111357224477998b265d45e3ee0d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/591d111357224477998b265d45e3ee0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:55:53.238710 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:53.238710 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:55:53.238710 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:53.238710 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:55:53.238710 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:55:53.238710 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:55:53.238710 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 6caa64aecb914e968d057b6b593f667f Jun 15 14:55:53.238710 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:55:53.238710 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:55:53.238710 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Instance 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 could not be found. Jun 15 14:55:53.238710 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': '96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965'} Jun 15 14:55:53.239598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:55:53.239598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:53.239598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:55:53.239598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:55:53.239598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:55:53.239598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:55:53.239598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:55:53.239598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:55:53.239598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:55:53.239598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:55:53.239598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 could not be found. Jun 15 14:55:53.239598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:53.239598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:55:53.239598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:53.239598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:53.239598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:55:53.239598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:55:53.239598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:55:53.239598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:55:53.239598 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:55:53.240917 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:55:53.240917 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:55:53.240917 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:55:53.240917 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:55:53.240917 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:55:53.240917 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:55:53.240917 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:55:53.240917 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 could not be found. Jun 15 14:55:53.240917 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:53.240917 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:55:53.240917 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:53.240917 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:53.240917 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:55:53.240917 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:55:53.240917 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:55:53.240917 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:55:53.240917 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 could not be found. Jun 15 14:55:53.240917 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:53.242148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c0b70b80-b7ed-465a-a2f1-4dea215ff716 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Returning 404 to user: Instance 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:55:53.242148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-c0b70b80-b7ed-465a-a2f1-4dea215ff716 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965" status: 404 len: 111 microversion: 2.1 time: 0.030653 Jun 15 14:55:53.242148 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 624/1221] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:53 2022] GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:55:53.247236 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-e7e8c976-c7aa-4fbf-9d94-3c847bb62b57 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '.version_select at 0x7f8f2279fee0>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:53.264688 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-e7e8c976-c7aa-4fbf-9d94-3c847bb62b57 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-483238921" status: 202 len: 0 microversion: 2.1 time: 0.021249 Jun 15 14:55:53.266160 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 598/1222] 10.222.0.57 () {58 vars in 1217 bytes} [Wed Jun 15 14:55:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-483238921 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:55:54.999528 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f3628d58-7609-4281-97aa-5dc085ac2e16 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:55.000036 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f3628d58-7609-4281-97aa-5dc085ac2e16 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:55.006505 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f3628d58-7609-4281-97aa-5dc085ac2e16 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:55.006952 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f3628d58-7609-4281-97aa-5dc085ac2e16 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:55.007714 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f3628d58-7609-4281-97aa-5dc085ac2e16 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:55.008152 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f3628d58-7609-4281-97aa-5dc085ac2e16 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:55.022114 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-f3628d58-7609-4281-97aa-5dc085ac2e16 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] HTTP exception thrown: Instance 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 could not be found. Jun 15 14:55:55.023639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f3628d58-7609-4281-97aa-5dc085ac2e16 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Request method failure captured: Jun 15 14:55:55.023639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: DELETE /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 HTTP/1.1 Jun 15 14:55:55.023639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:55:55.023639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:55:55.023639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:55:55.023639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:55:55.023639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:55:55.023639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:55:55.023639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:55:55.023639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:55:55.023639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfGtA81J1G_x2ff3wIk9WNt3QYmnBm26jR3C1Gs2is-P7wpJkQsDSBdU7d-N9JTLRxl70QNiPGwIBDR5YY-rvbFUD77VY73Ns036wSG64JihGQQVBXgVpi8TCxZ4jrtMxLvpDXwplGMkMYm1p0WTNbEoOI9C6x7l5c7PYtxIYCxejUU Jun 15 14:55:55.023639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:55:55.023639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:55:55.023639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:55:55.023639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:55:55.023639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:55:55.023639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:55:55.023639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:55:55.023639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:55.023639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:55:55.023639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:55:55.025279 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_591d111357224477998b265d45e3ee0d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/591d111357224477998b265d45e3ee0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:55:55.025279 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:55.025279 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:55:55.025279 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:55.025279 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:55:55.025279 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:55:55.025279 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:55:55.025279 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 6caa64aecb914e968d057b6b593f667f Jun 15 14:55:55.025279 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:55:55.025279 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:55:55.025279 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Instance 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 could not be found. Jun 15 14:55:55.025279 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': '96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965'} Jun 15 14:55:55.026291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:55:55.026291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:55.026291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:55:55.026291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:55:55.026291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:55:55.026291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:55:55.026291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:55:55.026291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:55:55.026291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:55:55.026291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:55:55.026291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 could not be found. Jun 15 14:55:55.026291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:55.026291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:55:55.026291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:55.026291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:55.026291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:55:55.026291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:55:55.026291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:55:55.026291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:55:55.026291 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:55:55.027766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:55:55.027766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 14:55:55.027766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 14:55:55.027766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 14:55:55.027766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 14:55:55.027766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:55:55.027766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:55:55.027766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:55:55.027766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:55:55.027766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 could not be found. Jun 15 14:55:55.027766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:55.027766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:55:55.027766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:55.027766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:55.027766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:55:55.027766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:55:55.027766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:55:55.027766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:55:55.027766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 could not be found. Jun 15 14:55:55.027766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:55.029434 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f3628d58-7609-4281-97aa-5dc085ac2e16 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Returning 404 to user: Instance 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:55:55.029434 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f3628d58-7609-4281-97aa-5dc085ac2e16 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "DELETE /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965" status: 404 len: 111 microversion: 2.1 time: 0.029284 Jun 15 14:55:55.029434 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 625/1223] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:55:54 2022] DELETE /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:55:55.036324 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6895d8b9-dab2-4315-89d4-2ffb7ffde516 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:55.036939 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-6895d8b9-dab2-4315-89d4-2ffb7ffde516 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:55.043445 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6895d8b9-dab2-4315-89d4-2ffb7ffde516 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:55.043893 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6895d8b9-dab2-4315-89d4-2ffb7ffde516 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:55.044707 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6895d8b9-dab2-4315-89d4-2ffb7ffde516 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:55.045143 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-6895d8b9-dab2-4315-89d4-2ffb7ffde516 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:55.058401 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.wsgi [None req-6895d8b9-dab2-4315-89d4-2ffb7ffde516 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] HTTP exception thrown: Instance 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 could not be found. Jun 15 14:55:55.060010 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6895d8b9-dab2-4315-89d4-2ffb7ffde516 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Request method failure captured: Jun 15 14:55:55.060010 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: request: GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 HTTP/1.1 Jun 15 14:55:55.060010 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept: application/json Jun 15 14:55:55.060010 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept-Encoding: identity Jun 15 14:55:55.060010 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Connection: close Jun 15 14:55:55.060010 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Length: 0 Jun 15 14:55:55.060010 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Type: application/json Jun 15 14:55:55.060010 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Host: 10.222.0.57 Jun 15 14:55:55.060010 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Openstack-System-Scope: None Jun 15 14:55:55.060010 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: User-Agent: python-urllib3/1.26.9 Jun 15 14:55:55.060010 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Auth-Token: gAAAAABiqfGtA81J1G_x2ff3wIk9WNt3QYmnBm26jR3C1Gs2is-P7wpJkQsDSBdU7d-N9JTLRxl70QNiPGwIBDR5YY-rvbFUD77VY73Ns036wSG64JihGQQVBXgVpi8TCxZ4jrtMxLvpDXwplGMkMYm1p0WTNbEoOI9C6x7l5c7PYtxIYCxejUU Jun 15 14:55:55.060010 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Id: None Jun 15 14:55:55.060010 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Name: None Jun 15 14:55:55.060010 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Identity-Status: Confirmed Jun 15 14:55:55.060010 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Is-Admin-Project: True Jun 15 14:55:55.060010 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Id: default Jun 15 14:55:55.060010 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Name: Default Jun 15 14:55:55.060010 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:55:55.060010 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:55.060010 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Role: member,reader Jun 15 14:55:55.060010 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Roles: member,reader Jun 15 14:55:55.061643 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_591d111357224477998b265d45e3ee0d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/591d111357224477998b265d45e3ee0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:55:55.061643 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:55.061643 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:55:55.061643 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:55.061643 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:55:55.061643 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Id: default Jun 15 14:55:55.061643 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Name: Default Jun 15 14:55:55.061643 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Id: 6caa64aecb914e968d057b6b593f667f Jun 15 14:55:55.061643 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Name: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:55:55.061643 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: method: > Jun 15 14:55:55.061643 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: exception: Instance 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 could not be found. Jun 15 14:55:55.061643 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: action_args: {'id': '96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965'} Jun 15 14:55:55.062532 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:55:55.062532 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:55.062532 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:55:55.062532 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:55:55.062532 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:55:55.062532 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:55:55.062532 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:55:55.062532 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:55:55.062532 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:55:55.062532 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:55:55.062532 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 could not be found. Jun 15 14:55:55.062532 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:55:55.062532 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:55:55.062532 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:55:55.062532 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:55.062532 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:55:55.062532 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:55:55.062532 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:55:55.062532 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:55:55.062532 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:55:55.064153 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:55:55.064153 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:55:55.064153 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:55:55.064153 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:55:55.064153 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:55:55.064153 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:55:55.064153 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:55:55.064153 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 could not be found. Jun 15 14:55:55.064153 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:55:55.064153 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:55:55.064153 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:55:55.064153 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:55.064153 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:55:55.064153 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:55:55.064153 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:55:55.064153 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:55:55.064153 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 could not be found. Jun 15 14:55:55.064153 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:55:55.065484 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-6895d8b9-dab2-4315-89d4-2ffb7ffde516 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Returning 404 to user: Instance 96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 could not be found. {{(pid=124220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:55:55.065484 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-6895d8b9-dab2-4315-89d4-2ffb7ffde516 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965" status: 404 len: 111 microversion: 2.1 time: 0.030683 Jun 15 14:55:55.065484 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 599/1224] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:55 2022] GET /compute/v2.1/servers/96ae3f6d-87ee-4b4f-a44e-00b3b4d3c965 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:55:56.197294 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-a849a152-c032-418f-aa16-7a730e65fbef tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:56.197838 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-a849a152-c032-418f-aa16-7a730e65fbef tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:56.204594 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a849a152-c032-418f-aa16-7a730e65fbef tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:56.205048 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a849a152-c032-418f-aa16-7a730e65fbef tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:56.207220 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a849a152-c032-418f-aa16-7a730e65fbef tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:56.207657 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a849a152-c032-418f-aa16-7a730e65fbef tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:56.220682 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-a849a152-c032-418f-aa16-7a730e65fbef tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] HTTP exception thrown: Instance 15951a8f-0c58-442e-92b4-7e05d00d2929 could not be found. Jun 15 14:55:56.222789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-a849a152-c032-418f-aa16-7a730e65fbef tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Request method failure captured: Jun 15 14:55:56.222789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: DELETE /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 HTTP/1.1 Jun 15 14:55:56.222789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:55:56.222789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:55:56.222789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:55:56.222789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:55:56.222789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:55:56.222789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:55:56.222789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:55:56.222789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:55:56.222789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfGtA81J1G_x2ff3wIk9WNt3QYmnBm26jR3C1Gs2is-P7wpJkQsDSBdU7d-N9JTLRxl70QNiPGwIBDR5YY-rvbFUD77VY73Ns036wSG64JihGQQVBXgVpi8TCxZ4jrtMxLvpDXwplGMkMYm1p0WTNbEoOI9C6x7l5c7PYtxIYCxejUU Jun 15 14:55:56.222789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:55:56.222789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:55:56.222789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:55:56.222789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:55:56.222789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:55:56.222789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:55:56.222789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:55:56.222789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:56.222789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:55:56.222789 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:55:56.224529 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_591d111357224477998b265d45e3ee0d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/591d111357224477998b265d45e3ee0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:55:56.224529 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:56.224529 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:55:56.224529 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:56.224529 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:55:56.224529 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:55:56.224529 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:55:56.224529 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 6caa64aecb914e968d057b6b593f667f Jun 15 14:55:56.224529 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:55:56.224529 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:55:56.224529 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Instance 15951a8f-0c58-442e-92b4-7e05d00d2929 could not be found. Jun 15 14:55:56.224529 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': '15951a8f-0c58-442e-92b4-7e05d00d2929'} Jun 15 14:55:56.225570 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:55:56.225570 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:56.225570 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:55:56.225570 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:55:56.225570 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:55:56.225570 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:55:56.225570 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:55:56.225570 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:55:56.225570 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:55:56.225570 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:55:56.225570 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15951a8f-0c58-442e-92b4-7e05d00d2929 could not be found. Jun 15 14:55:56.225570 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:56.225570 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:55:56.225570 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:56.225570 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:56.225570 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:55:56.225570 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:55:56.225570 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:55:56.225570 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:55:56.225570 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:55:56.227257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:55:56.227257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 14:55:56.227257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 14:55:56.227257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 14:55:56.227257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 14:55:56.227257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:55:56.227257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:55:56.227257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:55:56.227257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:55:56.227257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15951a8f-0c58-442e-92b4-7e05d00d2929 could not be found. Jun 15 14:55:56.227257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:56.227257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:55:56.227257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:56.227257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:56.227257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:55:56.227257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:55:56.227257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:55:56.227257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:55:56.227257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15951a8f-0c58-442e-92b4-7e05d00d2929 could not be found. Jun 15 14:55:56.227257 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:56.228874 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-a849a152-c032-418f-aa16-7a730e65fbef tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Returning 404 to user: Instance 15951a8f-0c58-442e-92b4-7e05d00d2929 could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:55:56.228874 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-a849a152-c032-418f-aa16-7a730e65fbef tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "DELETE /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929" status: 404 len: 111 microversion: 2.1 time: 0.030705 Jun 15 14:55:56.228874 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 626/1225] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:55:56 2022] DELETE /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:55:56.233374 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c3d74bb1-713f-4b71-bdfa-3bf0331b45e5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:56.234268 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-c3d74bb1-713f-4b71-bdfa-3bf0331b45e5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 15951a8f-0c58-442e-92b4-7e05d00d2929] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:56.241005 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c3d74bb1-713f-4b71-bdfa-3bf0331b45e5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:56.241479 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c3d74bb1-713f-4b71-bdfa-3bf0331b45e5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:56.242265 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c3d74bb1-713f-4b71-bdfa-3bf0331b45e5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:56.242710 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-c3d74bb1-713f-4b71-bdfa-3bf0331b45e5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:56.256226 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.wsgi [None req-c3d74bb1-713f-4b71-bdfa-3bf0331b45e5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] HTTP exception thrown: Instance 15951a8f-0c58-442e-92b4-7e05d00d2929 could not be found. Jun 15 14:55:56.257767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c3d74bb1-713f-4b71-bdfa-3bf0331b45e5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Request method failure captured: Jun 15 14:55:56.257767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: request: GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 HTTP/1.1 Jun 15 14:55:56.257767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept: application/json Jun 15 14:55:56.257767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept-Encoding: identity Jun 15 14:55:56.257767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Connection: close Jun 15 14:55:56.257767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Length: 0 Jun 15 14:55:56.257767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Type: application/json Jun 15 14:55:56.257767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Host: 10.222.0.57 Jun 15 14:55:56.257767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Openstack-System-Scope: None Jun 15 14:55:56.257767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: User-Agent: python-urllib3/1.26.9 Jun 15 14:55:56.257767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Auth-Token: gAAAAABiqfGtA81J1G_x2ff3wIk9WNt3QYmnBm26jR3C1Gs2is-P7wpJkQsDSBdU7d-N9JTLRxl70QNiPGwIBDR5YY-rvbFUD77VY73Ns036wSG64JihGQQVBXgVpi8TCxZ4jrtMxLvpDXwplGMkMYm1p0WTNbEoOI9C6x7l5c7PYtxIYCxejUU Jun 15 14:55:56.257767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Id: None Jun 15 14:55:56.257767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Name: None Jun 15 14:55:56.257767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Identity-Status: Confirmed Jun 15 14:55:56.257767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Is-Admin-Project: True Jun 15 14:55:56.257767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Id: default Jun 15 14:55:56.257767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Name: Default Jun 15 14:55:56.257767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:55:56.257767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:56.257767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Role: member,reader Jun 15 14:55:56.257767 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Roles: member,reader Jun 15 14:55:56.259377 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_591d111357224477998b265d45e3ee0d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/591d111357224477998b265d45e3ee0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:55:56.259377 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:56.259377 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:55:56.259377 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:56.259377 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:55:56.259377 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Id: default Jun 15 14:55:56.259377 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Name: Default Jun 15 14:55:56.259377 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Id: 6caa64aecb914e968d057b6b593f667f Jun 15 14:55:56.259377 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Name: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:55:56.259377 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: method: > Jun 15 14:55:56.259377 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: exception: Instance 15951a8f-0c58-442e-92b4-7e05d00d2929 could not be found. Jun 15 14:55:56.259377 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: action_args: {'id': '15951a8f-0c58-442e-92b4-7e05d00d2929'} Jun 15 14:55:56.260552 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:55:56.260552 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:56.260552 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:55:56.260552 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:55:56.260552 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:55:56.260552 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:55:56.260552 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:55:56.260552 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:55:56.260552 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:55:56.260552 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:55:56.260552 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15951a8f-0c58-442e-92b4-7e05d00d2929 could not be found. Jun 15 14:55:56.260552 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:55:56.260552 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:55:56.260552 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:55:56.260552 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:56.260552 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:55:56.260552 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:55:56.260552 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:55:56.260552 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:55:56.260552 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:55:56.262124 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:55:56.262124 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:55:56.262124 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:55:56.262124 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:55:56.262124 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:55:56.262124 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:55:56.262124 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:55:56.262124 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15951a8f-0c58-442e-92b4-7e05d00d2929 could not be found. Jun 15 14:55:56.262124 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:55:56.262124 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:55:56.262124 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:55:56.262124 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:56.262124 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:55:56.262124 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:55:56.262124 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:55:56.262124 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:55:56.262124 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15951a8f-0c58-442e-92b4-7e05d00d2929 could not be found. Jun 15 14:55:56.262124 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:55:56.263494 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-c3d74bb1-713f-4b71-bdfa-3bf0331b45e5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Returning 404 to user: Instance 15951a8f-0c58-442e-92b4-7e05d00d2929 could not be found. {{(pid=124220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:55:56.263494 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-c3d74bb1-713f-4b71-bdfa-3bf0331b45e5 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929" status: 404 len: 111 microversion: 2.1 time: 0.029655 Jun 15 14:55:56.263494 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 600/1226] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:56 2022] GET /compute/v2.1/servers/15951a8f-0c58-442e-92b4-7e05d00d2929 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:55:56.268641 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0591d81e-edff-45db-a04c-f5a13e944261 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:56.269424 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-0591d81e-edff-45db-a04c-f5a13e944261 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:56.276386 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0591d81e-edff-45db-a04c-f5a13e944261 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:56.276838 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0591d81e-edff-45db-a04c-f5a13e944261 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:56.277601 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0591d81e-edff-45db-a04c-f5a13e944261 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:56.278064 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-0591d81e-edff-45db-a04c-f5a13e944261 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:56.291202 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-0591d81e-edff-45db-a04c-f5a13e944261 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] HTTP exception thrown: Instance 3f35bd7e-d113-487b-9ed4-a312a5ee780f could not be found. Jun 15 14:55:56.292758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0591d81e-edff-45db-a04c-f5a13e944261 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Request method failure captured: Jun 15 14:55:56.292758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: DELETE /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f HTTP/1.1 Jun 15 14:55:56.292758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:55:56.292758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:55:56.292758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:55:56.292758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:55:56.292758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:55:56.292758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:55:56.292758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:55:56.292758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:55:56.292758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfGtA81J1G_x2ff3wIk9WNt3QYmnBm26jR3C1Gs2is-P7wpJkQsDSBdU7d-N9JTLRxl70QNiPGwIBDR5YY-rvbFUD77VY73Ns036wSG64JihGQQVBXgVpi8TCxZ4jrtMxLvpDXwplGMkMYm1p0WTNbEoOI9C6x7l5c7PYtxIYCxejUU Jun 15 14:55:56.292758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:55:56.292758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:55:56.292758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:55:56.292758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:55:56.292758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:55:56.292758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:55:56.292758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:55:56.292758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:56.292758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:55:56.292758 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:55:56.294411 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_591d111357224477998b265d45e3ee0d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/591d111357224477998b265d45e3ee0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:55:56.294411 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:56.294411 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:55:56.294411 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:56.294411 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:55:56.294411 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:55:56.294411 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:55:56.294411 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 6caa64aecb914e968d057b6b593f667f Jun 15 14:55:56.294411 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:55:56.294411 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:55:56.294411 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Instance 3f35bd7e-d113-487b-9ed4-a312a5ee780f could not be found. Jun 15 14:55:56.294411 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': '3f35bd7e-d113-487b-9ed4-a312a5ee780f'} Jun 15 14:55:56.295517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:55:56.295517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:56.295517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:55:56.295517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:55:56.295517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:55:56.295517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:55:56.295517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:55:56.295517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:55:56.295517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:55:56.295517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:55:56.295517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f35bd7e-d113-487b-9ed4-a312a5ee780f could not be found. Jun 15 14:55:56.295517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:56.295517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:55:56.295517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:56.295517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:56.295517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:55:56.295517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:55:56.295517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:55:56.295517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:55:56.295517 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:55:56.296970 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:55:56.296970 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 14:55:56.296970 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 14:55:56.296970 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 14:55:56.296970 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 14:55:56.296970 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:55:56.296970 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:55:56.296970 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:55:56.296970 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:55:56.296970 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f35bd7e-d113-487b-9ed4-a312a5ee780f could not be found. Jun 15 14:55:56.296970 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:56.296970 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:55:56.296970 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:56.296970 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:56.296970 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:55:56.296970 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:55:56.296970 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:55:56.296970 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:55:56.296970 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f35bd7e-d113-487b-9ed4-a312a5ee780f could not be found. Jun 15 14:55:56.296970 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:56.298818 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-0591d81e-edff-45db-a04c-f5a13e944261 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Returning 404 to user: Instance 3f35bd7e-d113-487b-9ed4-a312a5ee780f could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:55:56.298818 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-0591d81e-edff-45db-a04c-f5a13e944261 tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f" status: 404 len: 111 microversion: 2.1 time: 0.030443 Jun 15 14:55:56.298818 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 627/1227] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:55:56 2022] DELETE /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:55:56.302685 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1bf79a5a-6030-42e5-b98b-4d4a6aa26fae tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:56.303309 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1bf79a5a-6030-42e5-b98b-4d4a6aa26fae tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: 3f35bd7e-d113-487b-9ed4-a312a5ee780f] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:56.309297 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1bf79a5a-6030-42e5-b98b-4d4a6aa26fae tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:56.309796 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1bf79a5a-6030-42e5-b98b-4d4a6aa26fae tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:56.310568 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1bf79a5a-6030-42e5-b98b-4d4a6aa26fae tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:56.311038 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1bf79a5a-6030-42e5-b98b-4d4a6aa26fae tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:56.324831 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.wsgi [None req-1bf79a5a-6030-42e5-b98b-4d4a6aa26fae tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] HTTP exception thrown: Instance 3f35bd7e-d113-487b-9ed4-a312a5ee780f could not be found. Jun 15 14:55:56.326372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1bf79a5a-6030-42e5-b98b-4d4a6aa26fae tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Request method failure captured: Jun 15 14:55:56.326372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: request: GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f HTTP/1.1 Jun 15 14:55:56.326372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept: application/json Jun 15 14:55:56.326372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept-Encoding: identity Jun 15 14:55:56.326372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Connection: close Jun 15 14:55:56.326372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Length: 0 Jun 15 14:55:56.326372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Type: application/json Jun 15 14:55:56.326372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Host: 10.222.0.57 Jun 15 14:55:56.326372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Openstack-System-Scope: None Jun 15 14:55:56.326372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: User-Agent: python-urllib3/1.26.9 Jun 15 14:55:56.326372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Auth-Token: gAAAAABiqfGtA81J1G_x2ff3wIk9WNt3QYmnBm26jR3C1Gs2is-P7wpJkQsDSBdU7d-N9JTLRxl70QNiPGwIBDR5YY-rvbFUD77VY73Ns036wSG64JihGQQVBXgVpi8TCxZ4jrtMxLvpDXwplGMkMYm1p0WTNbEoOI9C6x7l5c7PYtxIYCxejUU Jun 15 14:55:56.326372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Id: None Jun 15 14:55:56.326372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Name: None Jun 15 14:55:56.326372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Identity-Status: Confirmed Jun 15 14:55:56.326372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Is-Admin-Project: True Jun 15 14:55:56.326372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Id: default Jun 15 14:55:56.326372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Name: Default Jun 15 14:55:56.326372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:55:56.326372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:56.326372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Role: member,reader Jun 15 14:55:56.326372 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Roles: member,reader Jun 15 14:55:56.327959 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_591d111357224477998b265d45e3ee0d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/591d111357224477998b265d45e3ee0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:55:56.327959 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:56.327959 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:55:56.327959 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:56.327959 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:55:56.327959 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Id: default Jun 15 14:55:56.327959 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Name: Default Jun 15 14:55:56.327959 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Id: 6caa64aecb914e968d057b6b593f667f Jun 15 14:55:56.327959 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Name: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:55:56.327959 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: method: > Jun 15 14:55:56.327959 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: exception: Instance 3f35bd7e-d113-487b-9ed4-a312a5ee780f could not be found. Jun 15 14:55:56.327959 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: action_args: {'id': '3f35bd7e-d113-487b-9ed4-a312a5ee780f'} Jun 15 14:55:56.328855 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:55:56.328855 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:56.328855 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:55:56.328855 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:55:56.328855 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:55:56.328855 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:55:56.328855 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:55:56.328855 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:55:56.328855 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:55:56.328855 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:55:56.328855 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f35bd7e-d113-487b-9ed4-a312a5ee780f could not be found. Jun 15 14:55:56.328855 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:55:56.328855 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:55:56.328855 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:55:56.328855 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:56.328855 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:55:56.328855 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:55:56.328855 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:55:56.328855 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:55:56.328855 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:55:56.330363 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:55:56.330363 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:55:56.330363 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:55:56.330363 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:55:56.330363 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:55:56.330363 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:55:56.330363 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:55:56.330363 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f35bd7e-d113-487b-9ed4-a312a5ee780f could not be found. Jun 15 14:55:56.330363 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:55:56.330363 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:55:56.330363 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:55:56.330363 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:56.330363 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:55:56.330363 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:55:56.330363 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:55:56.330363 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:55:56.330363 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f35bd7e-d113-487b-9ed4-a312a5ee780f could not be found. Jun 15 14:55:56.330363 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:55:56.332646 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1bf79a5a-6030-42e5-b98b-4d4a6aa26fae tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Returning 404 to user: Instance 3f35bd7e-d113-487b-9ed4-a312a5ee780f could not be found. {{(pid=124220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:55:56.332646 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-1bf79a5a-6030-42e5-b98b-4d4a6aa26fae tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f" status: 404 len: 111 microversion: 2.1 time: 0.029026 Jun 15 14:55:56.332646 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 601/1228] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:56 2022] GET /compute/v2.1/servers/3f35bd7e-d113-487b-9ed4-a312a5ee780f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:55:57.465327 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-1732f8eb-c217-432b-ba04-5eb4ad6033cd tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:57.466380 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-1732f8eb-c217-432b-ba04-5eb4ad6033cd tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:57.473313 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1732f8eb-c217-432b-ba04-5eb4ad6033cd tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:57.473792 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1732f8eb-c217-432b-ba04-5eb4ad6033cd tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:57.474551 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1732f8eb-c217-432b-ba04-5eb4ad6033cd tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:57.474983 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-1732f8eb-c217-432b-ba04-5eb4ad6033cd tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:57.489194 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-1732f8eb-c217-432b-ba04-5eb4ad6033cd tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] HTTP exception thrown: Instance a97884f7-868c-4b2a-b518-feac560b9eff could not be found. Jun 15 14:55:57.490814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-1732f8eb-c217-432b-ba04-5eb4ad6033cd tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Request method failure captured: Jun 15 14:55:57.490814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: DELETE /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff HTTP/1.1 Jun 15 14:55:57.490814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:55:57.490814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:55:57.490814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:55:57.490814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:55:57.490814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:55:57.490814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:55:57.490814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:55:57.490814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:55:57.490814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfGtA81J1G_x2ff3wIk9WNt3QYmnBm26jR3C1Gs2is-P7wpJkQsDSBdU7d-N9JTLRxl70QNiPGwIBDR5YY-rvbFUD77VY73Ns036wSG64JihGQQVBXgVpi8TCxZ4jrtMxLvpDXwplGMkMYm1p0WTNbEoOI9C6x7l5c7PYtxIYCxejUU Jun 15 14:55:57.490814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:55:57.490814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:55:57.490814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:55:57.490814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:55:57.490814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:55:57.490814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:55:57.490814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:55:57.490814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:57.490814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:55:57.490814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:55:57.492377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_591d111357224477998b265d45e3ee0d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/591d111357224477998b265d45e3ee0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:55:57.492377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:57.492377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:55:57.492377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:57.492377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:55:57.492377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:55:57.492377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:55:57.492377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 6caa64aecb914e968d057b6b593f667f Jun 15 14:55:57.492377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:55:57.492377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:55:57.492377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Instance a97884f7-868c-4b2a-b518-feac560b9eff could not be found. Jun 15 14:55:57.492377 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': 'a97884f7-868c-4b2a-b518-feac560b9eff'} Jun 15 14:55:57.493284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:55:57.493284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:57.493284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:55:57.493284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:55:57.493284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:55:57.493284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:55:57.493284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:55:57.493284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:55:57.493284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:55:57.493284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:55:57.493284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a97884f7-868c-4b2a-b518-feac560b9eff could not be found. Jun 15 14:55:57.493284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:57.493284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:55:57.493284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:57.493284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:57.493284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:55:57.493284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:55:57.493284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:55:57.493284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:55:57.493284 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:55:57.494835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:55:57.494835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 14:55:57.494835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 14:55:57.494835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 14:55:57.494835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 14:55:57.494835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:55:57.494835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:55:57.494835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:55:57.494835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:55:57.494835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a97884f7-868c-4b2a-b518-feac560b9eff could not be found. Jun 15 14:55:57.494835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:57.494835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:55:57.494835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:57.494835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:57.494835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:55:57.494835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:55:57.494835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:55:57.494835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:55:57.494835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a97884f7-868c-4b2a-b518-feac560b9eff could not be found. Jun 15 14:55:57.494835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:55:57.496307 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-1732f8eb-c217-432b-ba04-5eb4ad6033cd tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Returning 404 to user: Instance a97884f7-868c-4b2a-b518-feac560b9eff could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:55:57.496307 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-1732f8eb-c217-432b-ba04-5eb4ad6033cd tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 404 len: 111 microversion: 2.1 time: 0.030716 Jun 15 14:55:57.496307 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 628/1229] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:55:57 2022] DELETE /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:55:57.500648 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a372ad76-6ae9-4cb0-895e-9bf248359fed tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:57.501262 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-a372ad76-6ae9-4cb0-895e-9bf248359fed tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] [instance: a97884f7-868c-4b2a-b518-feac560b9eff] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:57.508442 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a372ad76-6ae9-4cb0-895e-9bf248359fed tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:57.508885 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a372ad76-6ae9-4cb0-895e-9bf248359fed tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:57.509635 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a372ad76-6ae9-4cb0-895e-9bf248359fed tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:57.510089 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-a372ad76-6ae9-4cb0-895e-9bf248359fed tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:57.524363 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.wsgi [None req-a372ad76-6ae9-4cb0-895e-9bf248359fed tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] HTTP exception thrown: Instance a97884f7-868c-4b2a-b518-feac560b9eff could not be found. Jun 15 14:55:57.525924 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a372ad76-6ae9-4cb0-895e-9bf248359fed tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Request method failure captured: Jun 15 14:55:57.525924 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: request: GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff HTTP/1.1 Jun 15 14:55:57.525924 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept: application/json Jun 15 14:55:57.525924 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept-Encoding: identity Jun 15 14:55:57.525924 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Connection: close Jun 15 14:55:57.525924 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Length: 0 Jun 15 14:55:57.525924 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Type: application/json Jun 15 14:55:57.525924 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Host: 10.222.0.57 Jun 15 14:55:57.525924 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Openstack-System-Scope: None Jun 15 14:55:57.525924 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: User-Agent: python-urllib3/1.26.9 Jun 15 14:55:57.525924 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Auth-Token: gAAAAABiqfGtA81J1G_x2ff3wIk9WNt3QYmnBm26jR3C1Gs2is-P7wpJkQsDSBdU7d-N9JTLRxl70QNiPGwIBDR5YY-rvbFUD77VY73Ns036wSG64JihGQQVBXgVpi8TCxZ4jrtMxLvpDXwplGMkMYm1p0WTNbEoOI9C6x7l5c7PYtxIYCxejUU Jun 15 14:55:57.525924 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Id: None Jun 15 14:55:57.525924 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Name: None Jun 15 14:55:57.525924 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Identity-Status: Confirmed Jun 15 14:55:57.525924 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Is-Admin-Project: True Jun 15 14:55:57.525924 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Id: default Jun 15 14:55:57.525924 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Name: Default Jun 15 14:55:57.525924 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:55:57.525924 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:57.525924 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Role: member,reader Jun 15 14:55:57.525924 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Roles: member,reader Jun 15 14:55:57.527510 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_591d111357224477998b265d45e3ee0d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/591d111357224477998b265d45e3ee0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/591d111357224477998b265d45e3ee0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:55:57.527510 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:57.527510 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Id: 591d111357224477998b265d45e3ee0d Jun 15 14:55:57.527510 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470221436 Jun 15 14:55:57.527510 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:55:57.527510 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Id: default Jun 15 14:55:57.527510 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Name: Default Jun 15 14:55:57.527510 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Id: 6caa64aecb914e968d057b6b593f667f Jun 15 14:55:57.527510 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Name: tempest-AttachVolumeNegativeTest-470221436-project Jun 15 14:55:57.527510 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: method: > Jun 15 14:55:57.527510 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: exception: Instance a97884f7-868c-4b2a-b518-feac560b9eff could not be found. Jun 15 14:55:57.527510 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: action_args: {'id': 'a97884f7-868c-4b2a-b518-feac560b9eff'} Jun 15 14:55:57.528388 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:55:57.528388 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:57.528388 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:55:57.528388 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:55:57.528388 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:55:57.528388 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:55:57.528388 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:55:57.528388 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:55:57.528388 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:55:57.528388 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:55:57.528388 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a97884f7-868c-4b2a-b518-feac560b9eff could not be found. Jun 15 14:55:57.528388 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:55:57.528388 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:55:57.528388 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:55:57.528388 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:57.528388 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:55:57.528388 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:55:57.528388 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:55:57.528388 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:55:57.528388 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:55:57.529870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:55:57.529870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:55:57.529870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:55:57.529870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:55:57.529870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:55:57.529870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:55:57.529870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:55:57.529870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a97884f7-868c-4b2a-b518-feac560b9eff could not be found. Jun 15 14:55:57.529870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:55:57.529870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:55:57.529870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:55:57.529870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:55:57.529870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:55:57.529870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:55:57.529870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:55:57.529870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:55:57.529870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a97884f7-868c-4b2a-b518-feac560b9eff could not be found. Jun 15 14:55:57.529870 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:55:57.531172 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-a372ad76-6ae9-4cb0-895e-9bf248359fed tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] Returning 404 to user: Instance a97884f7-868c-4b2a-b518-feac560b9eff could not be found. {{(pid=124220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:55:57.531172 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-a372ad76-6ae9-4cb0-895e-9bf248359fed tempest-AttachVolumeNegativeTest-470221436 tempest-AttachVolumeNegativeTest-470221436-project] 10.222.0.57 "GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff" status: 404 len: 111 microversion: 2.1 time: 0.030524 Jun 15 14:55:57.531172 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 602/1230] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:57 2022] GET /compute/v2.1/servers/a97884f7-868c-4b2a-b518-feac560b9eff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:56:45.548523 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 14:56:45.549224 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Wed Jun 15 14:56:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 14:57:40.036618 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:40.037384 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:40.041231 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c2faebb2-0a1d-43f0-8bf5-641685b9507e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-65340501", "imageRef": "e18802bf-9dac-462c-88ba-5cce79043279", "flavorRef": "452", "networks": [{"uuid": "a7ba3854-ee52-4735-9169-81b50506e6c8"}]}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:57:40.093313 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.network.neutron [None req-c2faebb2-0a1d-43f0-8bf5-641685b9507e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] validate_networks() for [('a7ba3854-ee52-4735-9169-81b50506e6c8', None, None, None, None, None)] {{(pid=124219) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:57:40.444834 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-c2faebb2-0a1d-43f0-8bf5-641685b9507e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Flavor limits 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:57:40.445261 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-c2faebb2-0a1d-43f0-8bf5-641685b9507e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Image limits 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:57:40.445776 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-c2faebb2-0a1d-43f0-8bf5-641685b9507e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Flavor pref 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:57:40.446197 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-c2faebb2-0a1d-43f0-8bf5-641685b9507e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Image pref 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:57:40.446613 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-c2faebb2-0a1d-43f0-8bf5-641685b9507e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:57:40.456530 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c2faebb2-0a1d-43f0-8bf5-641685b9507e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:40.456937 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c2faebb2-0a1d-43f0-8bf5-641685b9507e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:40.457774 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c2faebb2-0a1d-43f0-8bf5-641685b9507e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:40.458218 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c2faebb2-0a1d-43f0-8bf5-641685b9507e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:40.474793 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-c2faebb2-0a1d-43f0-8bf5-641685b9507e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Getting quotas for project 4a8030c18a9947e3ad366c57f93b822c. Resources: {'cores', 'instances', 'ram'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:57:40.478759 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-c2faebb2-0a1d-43f0-8bf5-641685b9507e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Getting quotas for user 182f01dd545c415f87920f17908dbc20 and project 4a8030c18a9947e3ad366c57f93b822c. Resources: {'cores', 'instances', 'ram'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:57:40.490033 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c2faebb2-0a1d-43f0-8bf5-641685b9507e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Going to run 1 instances... {{(pid=124219) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:57:40.492549 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c2faebb2-0a1d-43f0-8bf5-641685b9507e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: ba717adf-defd-4805-a0ef-a0daccaf58fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e18802bf-9dac-462c-88ba-5cce79043279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124219) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:57:40.538509 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-c2faebb2-0a1d-43f0-8bf5-641685b9507e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503674 Jun 15 14:57:40.539156 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 629/1231] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 14:57:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:57:40.547297 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:40.548139 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:40.552079 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-bbe4cc9e-7c9a-4f00-83e8-f8b47664c766 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:40.552690 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-bbe4cc9e-7c9a-4f00-83e8-f8b47664c766 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: ba717adf-defd-4805-a0ef-a0daccaf58fd] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:40.612467 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-bbe4cc9e-7c9a-4f00-83e8-f8b47664c766 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182f01dd545c415f87920f17908dbc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8030c18a9947e3ad366c57f93b822c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:40.619621 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-bbe4cc9e-7c9a-4f00-83e8-f8b47664c766 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd" status: 200 len: 1217 microversion: 2.1 time: 0.074526 Jun 15 14:57:40.620345 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 603/1232] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:40 2022] GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd => generated 1217 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:57:41.637735 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-eb0ae22b-74c4-4c98-8cc6-0e7861a578d5 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:41.638536 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-eb0ae22b-74c4-4c98-8cc6-0e7861a578d5 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: ba717adf-defd-4805-a0ef-a0daccaf58fd] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:41.646108 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-eb0ae22b-74c4-4c98-8cc6-0e7861a578d5 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:41.646646 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-eb0ae22b-74c4-4c98-8cc6-0e7861a578d5 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:41.647521 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-eb0ae22b-74c4-4c98-8cc6-0e7861a578d5 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:41.648041 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-eb0ae22b-74c4-4c98-8cc6-0e7861a578d5 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:41.726625 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-eb0ae22b-74c4-4c98-8cc6-0e7861a578d5 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182f01dd545c415f87920f17908dbc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8030c18a9947e3ad366c57f93b822c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:41.734766 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-eb0ae22b-74c4-4c98-8cc6-0e7861a578d5 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd" status: 200 len: 1287 microversion: 2.1 time: 0.101622 Jun 15 14:57:41.735402 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 630/1233] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:41 2022] GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd => generated 1287 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:42.752544 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-61de6195-c4b8-46f9-89c0-a31f0e623eca tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:42.753170 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-61de6195-c4b8-46f9-89c0-a31f0e623eca tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: ba717adf-defd-4805-a0ef-a0daccaf58fd] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:42.762473 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-61de6195-c4b8-46f9-89c0-a31f0e623eca tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:42.762932 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-61de6195-c4b8-46f9-89c0-a31f0e623eca tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:42.763712 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-61de6195-c4b8-46f9-89c0-a31f0e623eca tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:42.764160 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-61de6195-c4b8-46f9-89c0-a31f0e623eca tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:42.883582 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-d8651a05-a9ce-4a58-b23b-21df807dd3b0 req-5314ceda-740e-42e9-b33a-83f3c5070474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba717adf-defd-4805-a0ef-a0daccaf58fd", "tag": "3d37ef94-e2f5-4181-b891-ad1d79ba8953"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:57:42.892435 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-d8651a05-a9ce-4a58-b23b-21df807dd3b0 req-5314ceda-740e-42e9-b33a-83f3c5070474 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:42.893210 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-d8651a05-a9ce-4a58-b23b-21df807dd3b0 req-5314ceda-740e-42e9-b33a-83f3c5070474 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:42.908098 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-61de6195-c4b8-46f9-89c0-a31f0e623eca tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182f01dd545c415f87920f17908dbc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8030c18a9947e3ad366c57f93b822c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:42.917519 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-d8651a05-a9ce-4a58-b23b-21df807dd3b0 req-5314ceda-740e-42e9-b33a-83f3c5070474 service nova] Creating event network-changed:3d37ef94-e2f5-4181-b891-ad1d79ba8953 for instance ba717adf-defd-4805-a0ef-a0daccaf58fd on hv-cinder-84327 Jun 15 14:57:42.923481 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-d8651a05-a9ce-4a58-b23b-21df807dd3b0 req-5314ceda-740e-42e9-b33a-83f3c5070474 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043694 Jun 15 14:57:42.924601 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 631/1234] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:57:42.925115 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-61de6195-c4b8-46f9-89c0-a31f0e623eca tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd" status: 200 len: 1317 microversion: 2.1 time: 0.176491 Jun 15 14:57:42.927976 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 604/1235] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:42 2022] GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:43.943844 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-ed17f95b-2dad-45ec-9cda-140abfd3c004 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:43.944550 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-ed17f95b-2dad-45ec-9cda-140abfd3c004 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: ba717adf-defd-4805-a0ef-a0daccaf58fd] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:43.950782 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ed17f95b-2dad-45ec-9cda-140abfd3c004 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:43.951234 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ed17f95b-2dad-45ec-9cda-140abfd3c004 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:43.951998 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ed17f95b-2dad-45ec-9cda-140abfd3c004 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:43.952444 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-ed17f95b-2dad-45ec-9cda-140abfd3c004 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:44.086303 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-ed17f95b-2dad-45ec-9cda-140abfd3c004 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182f01dd545c415f87920f17908dbc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8030c18a9947e3ad366c57f93b822c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:44.094244 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-ed17f95b-2dad-45ec-9cda-140abfd3c004 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd" status: 200 len: 1317 microversion: 2.1 time: 0.154500 Jun 15 14:57:44.094835 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 632/1236] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:43 2022] GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:45.111781 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-4fe7dde8-43fe-4971-b0f2-ed3176afa13e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:45.112394 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-4fe7dde8-43fe-4971-b0f2-ed3176afa13e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: ba717adf-defd-4805-a0ef-a0daccaf58fd] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:45.119122 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4fe7dde8-43fe-4971-b0f2-ed3176afa13e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:45.119572 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4fe7dde8-43fe-4971-b0f2-ed3176afa13e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:45.120330 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4fe7dde8-43fe-4971-b0f2-ed3176afa13e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:45.120769 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4fe7dde8-43fe-4971-b0f2-ed3176afa13e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:45.246194 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-4fe7dde8-43fe-4971-b0f2-ed3176afa13e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182f01dd545c415f87920f17908dbc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8030c18a9947e3ad366c57f93b822c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:45.253815 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-4fe7dde8-43fe-4971-b0f2-ed3176afa13e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd" status: 200 len: 1317 microversion: 2.1 time: 0.146643 Jun 15 14:57:45.254368 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 605/1237] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:45 2022] GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:46.270735 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-8026be8e-004d-4d82-bda9-91018282f562 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:46.271342 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-8026be8e-004d-4d82-bda9-91018282f562 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: ba717adf-defd-4805-a0ef-a0daccaf58fd] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:46.277778 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8026be8e-004d-4d82-bda9-91018282f562 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:46.278220 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8026be8e-004d-4d82-bda9-91018282f562 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:46.278981 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8026be8e-004d-4d82-bda9-91018282f562 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:46.279409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-8026be8e-004d-4d82-bda9-91018282f562 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:46.413146 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-8026be8e-004d-4d82-bda9-91018282f562 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182f01dd545c415f87920f17908dbc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8030c18a9947e3ad366c57f93b822c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:46.420511 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-8026be8e-004d-4d82-bda9-91018282f562 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd" status: 200 len: 1317 microversion: 2.1 time: 0.153837 Jun 15 14:57:46.421076 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 633/1238] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:46 2022] GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:47.438941 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-09ad713c-ff93-439b-80d2-dcc06110c117 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:47.439608 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-09ad713c-ff93-439b-80d2-dcc06110c117 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: ba717adf-defd-4805-a0ef-a0daccaf58fd] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:47.446157 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-09ad713c-ff93-439b-80d2-dcc06110c117 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:47.446606 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-09ad713c-ff93-439b-80d2-dcc06110c117 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:47.447383 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-09ad713c-ff93-439b-80d2-dcc06110c117 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:47.447822 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-09ad713c-ff93-439b-80d2-dcc06110c117 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:47.579264 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-09ad713c-ff93-439b-80d2-dcc06110c117 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182f01dd545c415f87920f17908dbc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8030c18a9947e3ad366c57f93b822c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:47.586650 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-09ad713c-ff93-439b-80d2-dcc06110c117 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd" status: 200 len: 1317 microversion: 2.1 time: 0.152121 Jun 15 14:57:47.587431 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 606/1239] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:47 2022] GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:48.604475 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-5fbeaa70-9569-4191-ba3c-3877a6db1208 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:48.605088 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-5fbeaa70-9569-4191-ba3c-3877a6db1208 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: ba717adf-defd-4805-a0ef-a0daccaf58fd] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:48.612498 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5fbeaa70-9569-4191-ba3c-3877a6db1208 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:48.612950 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5fbeaa70-9569-4191-ba3c-3877a6db1208 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:48.613772 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5fbeaa70-9569-4191-ba3c-3877a6db1208 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:48.614212 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-5fbeaa70-9569-4191-ba3c-3877a6db1208 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:48.654213 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-3af91dd1-3988-405a-8726-8ddef82fa0a0 req-66032242-3710-4eb9-a108-2401df78bd52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba717adf-defd-4805-a0ef-a0daccaf58fd", "name": "network-vif-plugged", "status": "completed", "tag": "3d37ef94-e2f5-4181-b891-ad1d79ba8953"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:57:48.663684 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-3af91dd1-3988-405a-8726-8ddef82fa0a0 req-66032242-3710-4eb9-a108-2401df78bd52 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:48.664197 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-3af91dd1-3988-405a-8726-8ddef82fa0a0 req-66032242-3710-4eb9-a108-2401df78bd52 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:48.676865 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-3af91dd1-3988-405a-8726-8ddef82fa0a0 req-66032242-3710-4eb9-a108-2401df78bd52 service nova] Creating event network-vif-plugged:3d37ef94-e2f5-4181-b891-ad1d79ba8953 for instance ba717adf-defd-4805-a0ef-a0daccaf58fd on hv-cinder-84327 Jun 15 14:57:48.682345 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-3af91dd1-3988-405a-8726-8ddef82fa0a0 req-66032242-3710-4eb9-a108-2401df78bd52 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031637 Jun 15 14:57:48.683109 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 607/1240] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:57:48.761018 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-5fbeaa70-9569-4191-ba3c-3877a6db1208 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182f01dd545c415f87920f17908dbc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8030c18a9947e3ad366c57f93b822c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:48.769400 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-5fbeaa70-9569-4191-ba3c-3877a6db1208 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd" status: 200 len: 1317 microversion: 2.1 time: 0.168819 Jun 15 14:57:48.770080 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 634/1241] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:48 2022] GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:49.788157 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-f93306e4-c74d-4006-a24e-ff7d2b1e7044 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:49.788858 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-f93306e4-c74d-4006-a24e-ff7d2b1e7044 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: ba717adf-defd-4805-a0ef-a0daccaf58fd] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:49.795055 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f93306e4-c74d-4006-a24e-ff7d2b1e7044 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:49.795504 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f93306e4-c74d-4006-a24e-ff7d2b1e7044 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:49.796259 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f93306e4-c74d-4006-a24e-ff7d2b1e7044 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:49.796698 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-f93306e4-c74d-4006-a24e-ff7d2b1e7044 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:49.926346 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-f93306e4-c74d-4006-a24e-ff7d2b1e7044 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182f01dd545c415f87920f17908dbc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8030c18a9947e3ad366c57f93b822c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:49.933587 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-f93306e4-c74d-4006-a24e-ff7d2b1e7044 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd" status: 200 len: 1317 microversion: 2.1 time: 0.150108 Jun 15 14:57:49.934164 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 608/1242] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:49 2022] GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:50.950321 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-b69ca06e-53ba-4c1a-a6dc-8e3135e1bded tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:50.950939 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-b69ca06e-53ba-4c1a-a6dc-8e3135e1bded tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: ba717adf-defd-4805-a0ef-a0daccaf58fd] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:50.953378 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=2 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:50.954070 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=6 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:50.960361 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b69ca06e-53ba-4c1a-a6dc-8e3135e1bded tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:50.960814 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b69ca06e-53ba-4c1a-a6dc-8e3135e1bded tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:50.961581 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b69ca06e-53ba-4c1a-a6dc-8e3135e1bded tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:50.962049 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-b69ca06e-53ba-4c1a-a6dc-8e3135e1bded tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:51.089509 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-b69ca06e-53ba-4c1a-a6dc-8e3135e1bded tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182f01dd545c415f87920f17908dbc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8030c18a9947e3ad366c57f93b822c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:51.097409 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-b69ca06e-53ba-4c1a-a6dc-8e3135e1bded tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd" status: 200 len: 1506 microversion: 2.1 time: 0.150909 Jun 15 14:57:51.098003 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 635/1243] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:50 2022] GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:06.187052 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-9dff1529-cea7-4243-adf2-e8f1fea81fe8 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b61f0a81-0bf4-4158-bb2d-0d634a51384c", "device": "/dev/sdb"}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:06.188614 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-9dff1529-cea7-4243-adf2-e8f1fea81fe8 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: ba717adf-defd-4805-a0ef-a0daccaf58fd] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:06.190805 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=2 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:06.191544 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=14 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:06.192286 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=26 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:06.199253 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9dff1529-cea7-4243-adf2-e8f1fea81fe8 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:06.199708 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9dff1529-cea7-4243-adf2-e8f1fea81fe8 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:06.200484 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9dff1529-cea7-4243-adf2-e8f1fea81fe8 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:06.200926 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-9dff1529-cea7-4243-adf2-e8f1fea81fe8 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:06.455991 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-9dff1529-cea7-4243-adf2-e8f1fea81fe8 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "POST /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272465 Jun 15 14:58:06.456504 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 609/1244] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 14:58:06 2022] POST /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:13.258529 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 14:58:13.259219 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Wed Jun 15 14:58:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 14:58:30.088196 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-72d9a9ce-fea0-4f81-ad6e-cafefd14db5e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:30.088732 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-72d9a9ce-fea0-4f81-ad6e-cafefd14db5e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: ba717adf-defd-4805-a0ef-a0daccaf58fd] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:30.090615 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:30.091412 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=34 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:30.097383 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-72d9a9ce-fea0-4f81-ad6e-cafefd14db5e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:30.097877 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-72d9a9ce-fea0-4f81-ad6e-cafefd14db5e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:30.098648 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-72d9a9ce-fea0-4f81-ad6e-cafefd14db5e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:30.099088 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-72d9a9ce-fea0-4f81-ad6e-cafefd14db5e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:30.314638 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.objects.instance [None req-72d9a9ce-fea0-4f81-ad6e-cafefd14db5e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lazy-loading 'services' on Instance uuid ba717adf-defd-4805-a0ef-a0daccaf58fd {{(pid=124219) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:58:30.387701 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-72d9a9ce-fea0-4f81-ad6e-cafefd14db5e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd/os-volume_attachments/b61f0a81-0bf4-4158-bb2d-0d634a51384c" status: 202 len: 0 microversion: 2.1 time: 0.303946 Jun 15 14:58:30.388460 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 636/1245] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Jun 15 14:58:30 2022] DELETE /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd/os-volume_attachments/b61f0a81-0bf4-4158-bb2d-0d634a51384c => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:58:31.500503 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=2 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:31.501405 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:31.505853 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-7e5564bf-de38-412c-ba3c-7ea5e02cf792 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:31.506473 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-7e5564bf-de38-412c-ba3c-7ea5e02cf792 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: ba717adf-defd-4805-a0ef-a0daccaf58fd] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:31.514801 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7e5564bf-de38-412c-ba3c-7ea5e02cf792 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:31.515246 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7e5564bf-de38-412c-ba3c-7ea5e02cf792 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:31.516004 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7e5564bf-de38-412c-ba3c-7ea5e02cf792 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:31.516439 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-7e5564bf-de38-412c-ba3c-7ea5e02cf792 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:31.544799 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-7e5564bf-de38-412c-ba3c-7ea5e02cf792 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: ba717adf-defd-4805-a0ef-a0daccaf58fd] Going to try to terminate instance {{(pid=124220) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:58:31.621333 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-7e5564bf-de38-412c-ba3c-7ea5e02cf792 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd" status: 204 len: 0 microversion: 2.1 time: 0.121714 Jun 15 14:58:31.622415 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 610/1246] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:58:31 2022] DELETE /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:58:31.631416 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-3b51f630-8992-4831-a35c-209afc29e869 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:31.632110 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-3b51f630-8992-4831-a35c-209afc29e869 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: ba717adf-defd-4805-a0ef-a0daccaf58fd] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:31.639578 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3b51f630-8992-4831-a35c-209afc29e869 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:31.640023 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3b51f630-8992-4831-a35c-209afc29e869 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:31.640777 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3b51f630-8992-4831-a35c-209afc29e869 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:31.641210 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-3b51f630-8992-4831-a35c-209afc29e869 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:31.770311 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-3b51f630-8992-4831-a35c-209afc29e869 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182f01dd545c415f87920f17908dbc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8030c18a9947e3ad366c57f93b822c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:31.777976 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-3b51f630-8992-4831-a35c-209afc29e869 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd" status: 200 len: 1512 microversion: 2.1 time: 0.150789 Jun 15 14:58:31.778542 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 637/1247] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:31 2022] GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:32.794599 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-e8f4d3ff-589f-420b-b3f9-128922b599ed tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:32.795304 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-e8f4d3ff-589f-420b-b3f9-128922b599ed tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: ba717adf-defd-4805-a0ef-a0daccaf58fd] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:32.801743 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e8f4d3ff-589f-420b-b3f9-128922b599ed tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:32.802197 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e8f4d3ff-589f-420b-b3f9-128922b599ed tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:32.802959 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e8f4d3ff-589f-420b-b3f9-128922b599ed tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:32.803396 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-e8f4d3ff-589f-420b-b3f9-128922b599ed tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:32.991821 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-e8f4d3ff-589f-420b-b3f9-128922b599ed tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182f01dd545c415f87920f17908dbc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8030c18a9947e3ad366c57f93b822c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:33.000128 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-e8f4d3ff-589f-420b-b3f9-128922b599ed tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd" status: 200 len: 1512 microversion: 2.1 time: 0.209914 Jun 15 14:58:33.000673 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 611/1248] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:32 2022] GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd => generated 1512 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:34.016775 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-07ceee6b-386a-4750-bcd8-f934799d62e5 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:34.017510 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-07ceee6b-386a-4750-bcd8-f934799d62e5 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: ba717adf-defd-4805-a0ef-a0daccaf58fd] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:34.023916 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-07ceee6b-386a-4750-bcd8-f934799d62e5 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:34.024450 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-07ceee6b-386a-4750-bcd8-f934799d62e5 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:34.025296 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-07ceee6b-386a-4750-bcd8-f934799d62e5 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:34.025942 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-07ceee6b-386a-4750-bcd8-f934799d62e5 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:34.060551 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-6655c3f9-fbcc-4d49-b794-4983001e15bf req-bb45f9ea-3489-4be6-bc7a-a709bba7db42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba717adf-defd-4805-a0ef-a0daccaf58fd", "name": "network-vif-deleted", "tag": "3d37ef94-e2f5-4181-b891-ad1d79ba8953"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:34.070167 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-6655c3f9-fbcc-4d49-b794-4983001e15bf req-bb45f9ea-3489-4be6-bc7a-a709bba7db42 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:34.070612 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-6655c3f9-fbcc-4d49-b794-4983001e15bf req-bb45f9ea-3489-4be6-bc7a-a709bba7db42 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:34.082817 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-6655c3f9-fbcc-4d49-b794-4983001e15bf req-bb45f9ea-3489-4be6-bc7a-a709bba7db42 service nova] Creating event network-vif-deleted:3d37ef94-e2f5-4181-b891-ad1d79ba8953 for instance ba717adf-defd-4805-a0ef-a0daccaf58fd on hv-cinder-84327 Jun 15 14:58:34.087967 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-6655c3f9-fbcc-4d49-b794-4983001e15bf req-bb45f9ea-3489-4be6-bc7a-a709bba7db42 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031855 Jun 15 14:58:34.088989 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 612/1249] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:58:34.101438 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-07ceee6b-386a-4750-bcd8-f934799d62e5 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182f01dd545c415f87920f17908dbc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8030c18a9947e3ad366c57f93b822c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:34.109800 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-07ceee6b-386a-4750-bcd8-f934799d62e5 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd" status: 200 len: 1470 microversion: 2.1 time: 0.097052 Jun 15 14:58:34.110360 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 638/1250] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:34 2022] GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd => generated 1470 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:35.127841 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-2aedf7b5-fb97-4add-bd29-598747f2a483 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:35.128586 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-2aedf7b5-fb97-4add-bd29-598747f2a483 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: ba717adf-defd-4805-a0ef-a0daccaf58fd] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:35.134836 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2aedf7b5-fb97-4add-bd29-598747f2a483 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:35.136125 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2aedf7b5-fb97-4add-bd29-598747f2a483 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:35.136898 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2aedf7b5-fb97-4add-bd29-598747f2a483 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:35.137343 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-2aedf7b5-fb97-4add-bd29-598747f2a483 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:35.150416 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.wsgi [None req-2aedf7b5-fb97-4add-bd29-598747f2a483 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] HTTP exception thrown: Instance ba717adf-defd-4805-a0ef-a0daccaf58fd could not be found. Jun 15 14:58:35.152039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-2aedf7b5-fb97-4add-bd29-598747f2a483 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Request method failure captured: Jun 15 14:58:35.152039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: request: GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd HTTP/1.1 Jun 15 14:58:35.152039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept: application/json Jun 15 14:58:35.152039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Accept-Encoding: identity Jun 15 14:58:35.152039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Connection: close Jun 15 14:58:35.152039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Length: 0 Jun 15 14:58:35.152039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Content-Type: application/json Jun 15 14:58:35.152039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Host: 10.222.0.57 Jun 15 14:58:35.152039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Openstack-System-Scope: None Jun 15 14:58:35.152039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: User-Agent: python-urllib3/1.26.9 Jun 15 14:58:35.152039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Auth-Token: gAAAAABiqfNiOH2050L4SPZ73b7dgIJIHJNTjL_h3-nLIwMVWSNRCe58uhBhdzr-doLkrECCCJuwBeLe-NH2OOvzmq93kWUp8fZgrLAt-cut04i5e791WwB1t-MbA6uFfdqIjXp128wUmfCQv-V1X32eYbg80desiGzVHJ8Im7ajId7fW6LLmQQ Jun 15 14:58:35.152039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Id: None Jun 15 14:58:35.152039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Domain-Name: None Jun 15 14:58:35.152039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Identity-Status: Confirmed Jun 15 14:58:35.152039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Is-Admin-Project: True Jun 15 14:58:35.152039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Id: default Jun 15 14:58:35.152039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Domain-Name: Default Jun 15 14:58:35.152039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Id: 4a8030c18a9947e3ad366c57f93b822c Jun 15 14:58:35.152039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Project-Name: tempest-VolumesSnapshotTestJSON-205823151 Jun 15 14:58:35.152039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Role: member,reader Jun 15 14:58:35.152039 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Roles: member,reader Jun 15 14:58:35.153880 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a8030c18a9947e3ad366c57f93b822c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a8030c18a9947e3ad366c57f93b822c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a8030c18a9947e3ad366c57f93b822c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a8030c18a9947e3ad366c57f93b822c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:58:35.153880 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant: tempest-VolumesSnapshotTestJSON-205823151 Jun 15 14:58:35.153880 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Id: 4a8030c18a9947e3ad366c57f93b822c Jun 15 14:58:35.153880 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-205823151 Jun 15 14:58:35.153880 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User: tempest-VolumesSnapshotTestJSON-205823151-project Jun 15 14:58:35.153880 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Id: default Jun 15 14:58:35.153880 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Domain-Name: Default Jun 15 14:58:35.153880 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Id: 182f01dd545c415f87920f17908dbc20 Jun 15 14:58:35.153880 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: X-User-Name: tempest-VolumesSnapshotTestJSON-205823151-project Jun 15 14:58:35.153880 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: method: > Jun 15 14:58:35.153880 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: exception: Instance ba717adf-defd-4805-a0ef-a0daccaf58fd could not be found. Jun 15 14:58:35.153880 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: action_args: {'id': 'ba717adf-defd-4805-a0ef-a0daccaf58fd'} Jun 15 14:58:35.157683 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:58:35.157683 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:35.157683 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:58:35.157683 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:58:35.157683 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:58:35.157683 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:58:35.157683 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:58:35.157683 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:58:35.157683 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:58:35.157683 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:58:35.157683 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba717adf-defd-4805-a0ef-a0daccaf58fd could not be found. Jun 15 14:58:35.157683 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:58:35.157683 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:35.157683 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:58:35.157683 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:35.157683 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:35.157683 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:35.157683 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:58:35.157683 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:58:35.157683 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:58:35.159452 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:58:35.159452 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:58:35.159452 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:58:35.159452 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:58:35.159452 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:58:35.159452 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:58:35.159452 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:58:35.159452 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba717adf-defd-4805-a0ef-a0daccaf58fd could not be found. Jun 15 14:58:35.159452 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:58:35.159452 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:35.159452 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:58:35.159452 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:35.159452 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:35.159452 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:35.159452 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:58:35.159452 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:58:35.159452 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba717adf-defd-4805-a0ef-a0daccaf58fd could not be found. Jun 15 14:58:35.159452 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: ERROR nova.api.openstack.wsgi Jun 15 14:58:35.160955 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-2aedf7b5-fb97-4add-bd29-598747f2a483 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Returning 404 to user: Instance ba717adf-defd-4805-a0ef-a0daccaf58fd could not be found. {{(pid=124220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:58:35.160955 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-2aedf7b5-fb97-4add-bd29-598747f2a483 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd" status: 404 len: 111 microversion: 2.1 time: 0.030375 Jun 15 14:58:35.160955 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 613/1251] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:35 2022] GET /compute/v2.1/servers/ba717adf-defd-4805-a0ef-a0daccaf58fd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:58:42.905733 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-f03c9ce5-2f1b-4433-a776-dc5aa83b59b3 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-37869542", "imageRef": "e18802bf-9dac-462c-88ba-5cce79043279", "flavorRef": "452", "networks": [{"uuid": "a7ba3854-ee52-4735-9169-81b50506e6c8"}]}} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:42.955930 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.network.neutron [None req-f03c9ce5-2f1b-4433-a776-dc5aa83b59b3 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] validate_networks() for [('a7ba3854-ee52-4735-9169-81b50506e6c8', None, None, None, None, None)] {{(pid=124219) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:58:43.290458 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-f03c9ce5-2f1b-4433-a776-dc5aa83b59b3 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Flavor limits 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:58:43.290875 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-f03c9ce5-2f1b-4433-a776-dc5aa83b59b3 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Image limits 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:58:43.291345 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-f03c9ce5-2f1b-4433-a776-dc5aa83b59b3 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Flavor pref 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:58:43.291749 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-f03c9ce5-2f1b-4433-a776-dc5aa83b59b3 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Image pref 0:0:0 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:58:43.292866 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.virt.hardware [None req-f03c9ce5-2f1b-4433-a776-dc5aa83b59b3 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124219) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:58:43.301532 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f03c9ce5-2f1b-4433-a776-dc5aa83b59b3 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:43.302009 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f03c9ce5-2f1b-4433-a776-dc5aa83b59b3 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:43.302791 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f03c9ce5-2f1b-4433-a776-dc5aa83b59b3 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:43.303220 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-f03c9ce5-2f1b-4433-a776-dc5aa83b59b3 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:43.320510 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-f03c9ce5-2f1b-4433-a776-dc5aa83b59b3 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Getting quotas for project 4a8030c18a9947e3ad366c57f93b822c. Resources: {'cores', 'instances', 'ram'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:58:43.324755 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.quota [None req-f03c9ce5-2f1b-4433-a776-dc5aa83b59b3 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Getting quotas for user 182f01dd545c415f87920f17908dbc20 and project 4a8030c18a9947e3ad366c57f93b822c. Resources: {'cores', 'instances', 'ram'} {{(pid=124219) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:58:43.336013 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f03c9ce5-2f1b-4433-a776-dc5aa83b59b3 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Going to run 1 instances... {{(pid=124219) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:58:43.338315 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-f03c9ce5-2f1b-4433-a776-dc5aa83b59b3 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: 778183d7-2a3c-4534-9d9d-2cf519d3e898] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e18802bf-9dac-462c-88ba-5cce79043279',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124219) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:58:43.384425 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-f03c9ce5-2f1b-4433-a776-dc5aa83b59b3 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.482414 Jun 15 14:58:43.384988 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 639/1252] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 14:58:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:58:43.395445 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-8ce7d488-bb3c-49ec-9e72-f6c507393e0e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:43.396051 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-8ce7d488-bb3c-49ec-9e72-f6c507393e0e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: 778183d7-2a3c-4534-9d9d-2cf519d3e898] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:43.452062 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-8ce7d488-bb3c-49ec-9e72-f6c507393e0e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182f01dd545c415f87920f17908dbc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8030c18a9947e3ad366c57f93b822c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:43.459669 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-8ce7d488-bb3c-49ec-9e72-f6c507393e0e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898" status: 200 len: 1217 microversion: 2.1 time: 0.068008 Jun 15 14:58:43.460915 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 614/1253] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:43 2022] GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:44.477685 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c63866d9-7bc1-4689-a276-5fbb44c61208 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:44.478448 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c63866d9-7bc1-4689-a276-5fbb44c61208 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: 778183d7-2a3c-4534-9d9d-2cf519d3e898] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:44.486329 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c63866d9-7bc1-4689-a276-5fbb44c61208 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:44.486923 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c63866d9-7bc1-4689-a276-5fbb44c61208 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:44.487840 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c63866d9-7bc1-4689-a276-5fbb44c61208 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:44.488376 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c63866d9-7bc1-4689-a276-5fbb44c61208 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:44.564518 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c63866d9-7bc1-4689-a276-5fbb44c61208 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182f01dd545c415f87920f17908dbc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8030c18a9947e3ad366c57f93b822c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:44.571920 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-c63866d9-7bc1-4689-a276-5fbb44c61208 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898" status: 200 len: 1275 microversion: 2.1 time: 0.098515 Jun 15 14:58:44.572472 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 640/1254] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:44 2022] GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898 => generated 1275 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:45.590696 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-42181f9c-3a20-41a9-8733-0f06868db4fe tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:45.591432 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-42181f9c-3a20-41a9-8733-0f06868db4fe tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: 778183d7-2a3c-4534-9d9d-2cf519d3e898] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:45.593880 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:45.600280 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-42181f9c-3a20-41a9-8733-0f06868db4fe tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:45.600734 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-42181f9c-3a20-41a9-8733-0f06868db4fe tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:45.601501 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-42181f9c-3a20-41a9-8733-0f06868db4fe tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:45.601970 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-42181f9c-3a20-41a9-8733-0f06868db4fe tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:45.738563 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-42181f9c-3a20-41a9-8733-0f06868db4fe tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182f01dd545c415f87920f17908dbc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8030c18a9947e3ad366c57f93b822c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:45.747324 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-42181f9c-3a20-41a9-8733-0f06868db4fe tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898" status: 200 len: 1317 microversion: 2.1 time: 0.160966 Jun 15 14:58:45.747913 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 615/1255] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:45 2022] GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:45.990842 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [req-97dc4af7-70ea-4b4e-8a50-75a72a392f7d req-2a1fca7b-9c08-4baa-8ee9-02c28e9c61d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "778183d7-2a3c-4534-9d9d-2cf519d3e898", "tag": "0ed5c056-af62-4b79-b51b-244eb0a402f7"}]} {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:46.006188 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-97dc4af7-70ea-4b4e-8a50-75a72a392f7d req-2a1fca7b-9c08-4baa-8ee9-02c28e9c61d4 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:46.006658 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [req-97dc4af7-70ea-4b4e-8a50-75a72a392f7d req-2a1fca7b-9c08-4baa-8ee9-02c28e9c61d4 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:46.018545 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.compute.server_external_events [req-97dc4af7-70ea-4b4e-8a50-75a72a392f7d req-2a1fca7b-9c08-4baa-8ee9-02c28e9c61d4 service nova] Creating event network-changed:0ed5c056-af62-4b79-b51b-244eb0a402f7 for instance 778183d7-2a3c-4534-9d9d-2cf519d3e898 on hv-cinder-84327 Jun 15 14:58:46.023261 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [req-97dc4af7-70ea-4b4e-8a50-75a72a392f7d req-2a1fca7b-9c08-4baa-8ee9-02c28e9c61d4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036051 Jun 15 14:58:46.023847 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 641/1256] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:46.764583 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1e4830ff-893e-4d31-b628-93a06cc52c7e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:46.765139 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1e4830ff-893e-4d31-b628-93a06cc52c7e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: 778183d7-2a3c-4534-9d9d-2cf519d3e898] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:46.771654 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1e4830ff-893e-4d31-b628-93a06cc52c7e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:46.772110 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1e4830ff-893e-4d31-b628-93a06cc52c7e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:46.772883 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1e4830ff-893e-4d31-b628-93a06cc52c7e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:46.773329 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1e4830ff-893e-4d31-b628-93a06cc52c7e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:46.904596 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-1e4830ff-893e-4d31-b628-93a06cc52c7e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182f01dd545c415f87920f17908dbc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8030c18a9947e3ad366c57f93b822c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:46.911930 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-1e4830ff-893e-4d31-b628-93a06cc52c7e tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898" status: 200 len: 1317 microversion: 2.1 time: 0.151797 Jun 15 14:58:46.912486 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 616/1257] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:46 2022] GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:47.930095 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-67c9638b-4570-4a16-8ba2-e8cdc2b6b4d4 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:47.930795 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-67c9638b-4570-4a16-8ba2-e8cdc2b6b4d4 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: 778183d7-2a3c-4534-9d9d-2cf519d3e898] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:47.937692 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-67c9638b-4570-4a16-8ba2-e8cdc2b6b4d4 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:47.938151 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-67c9638b-4570-4a16-8ba2-e8cdc2b6b4d4 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:47.938925 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-67c9638b-4570-4a16-8ba2-e8cdc2b6b4d4 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:47.939360 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-67c9638b-4570-4a16-8ba2-e8cdc2b6b4d4 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:48.080714 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-67c9638b-4570-4a16-8ba2-e8cdc2b6b4d4 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182f01dd545c415f87920f17908dbc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8030c18a9947e3ad366c57f93b822c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:48.088728 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-67c9638b-4570-4a16-8ba2-e8cdc2b6b4d4 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898" status: 200 len: 1317 microversion: 2.1 time: 0.163418 Jun 15 14:58:48.089708 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 642/1258] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:47 2022] GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:49.110647 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-85f200ba-4654-4b61-9a4d-fa1e8c067a4f tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:49.111270 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-85f200ba-4654-4b61-9a4d-fa1e8c067a4f tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: 778183d7-2a3c-4534-9d9d-2cf519d3e898] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:49.117800 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-85f200ba-4654-4b61-9a4d-fa1e8c067a4f tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:49.118256 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-85f200ba-4654-4b61-9a4d-fa1e8c067a4f tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:49.119020 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-85f200ba-4654-4b61-9a4d-fa1e8c067a4f tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:49.119463 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-85f200ba-4654-4b61-9a4d-fa1e8c067a4f tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:49.246383 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-85f200ba-4654-4b61-9a4d-fa1e8c067a4f tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182f01dd545c415f87920f17908dbc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8030c18a9947e3ad366c57f93b822c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:49.253833 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-85f200ba-4654-4b61-9a4d-fa1e8c067a4f tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898" status: 200 len: 1317 microversion: 2.1 time: 0.147065 Jun 15 14:58:49.254397 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 617/1259] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:49 2022] GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:50.270907 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-28754535-70aa-4500-ae83-bc3316fc90b7 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:50.271521 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-28754535-70aa-4500-ae83-bc3316fc90b7 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: 778183d7-2a3c-4534-9d9d-2cf519d3e898] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:50.278230 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-28754535-70aa-4500-ae83-bc3316fc90b7 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:50.278680 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-28754535-70aa-4500-ae83-bc3316fc90b7 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:50.279436 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-28754535-70aa-4500-ae83-bc3316fc90b7 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:50.279872 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-28754535-70aa-4500-ae83-bc3316fc90b7 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:50.410861 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-28754535-70aa-4500-ae83-bc3316fc90b7 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182f01dd545c415f87920f17908dbc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8030c18a9947e3ad366c57f93b822c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:50.418761 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-28754535-70aa-4500-ae83-bc3316fc90b7 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898" status: 200 len: 1317 microversion: 2.1 time: 0.151789 Jun 15 14:58:50.419315 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 643/1260] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:50 2022] GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:50.967330 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-3e855ea0-9629-4a0d-b3b4-b23de2120488 req-d7a97ea5-79e5-4cc4-8d58-00de69a11bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "778183d7-2a3c-4534-9d9d-2cf519d3e898", "name": "network-vif-plugged", "status": "completed", "tag": "0ed5c056-af62-4b79-b51b-244eb0a402f7"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:50.977964 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-3e855ea0-9629-4a0d-b3b4-b23de2120488 req-d7a97ea5-79e5-4cc4-8d58-00de69a11bc1 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:50.978423 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-3e855ea0-9629-4a0d-b3b4-b23de2120488 req-d7a97ea5-79e5-4cc4-8d58-00de69a11bc1 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:50.993614 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-3e855ea0-9629-4a0d-b3b4-b23de2120488 req-d7a97ea5-79e5-4cc4-8d58-00de69a11bc1 service nova] Creating event network-vif-plugged:0ed5c056-af62-4b79-b51b-244eb0a402f7 for instance 778183d7-2a3c-4534-9d9d-2cf519d3e898 on hv-cinder-84327 Jun 15 14:58:50.999553 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-3e855ea0-9629-4a0d-b3b4-b23de2120488 req-d7a97ea5-79e5-4cc4-8d58-00de69a11bc1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037320 Jun 15 14:58:51.000138 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 618/1261] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:51.436326 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-69f279c6-4572-4399-b052-7ba356eec9da tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:51.436950 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-69f279c6-4572-4399-b052-7ba356eec9da tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: 778183d7-2a3c-4534-9d9d-2cf519d3e898] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:51.443435 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-69f279c6-4572-4399-b052-7ba356eec9da tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:51.443885 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-69f279c6-4572-4399-b052-7ba356eec9da tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:51.444645 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-69f279c6-4572-4399-b052-7ba356eec9da tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:51.445079 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-69f279c6-4572-4399-b052-7ba356eec9da tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:51.577994 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-69f279c6-4572-4399-b052-7ba356eec9da tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182f01dd545c415f87920f17908dbc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8030c18a9947e3ad366c57f93b822c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:51.585293 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-69f279c6-4572-4399-b052-7ba356eec9da tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898" status: 200 len: 1317 microversion: 2.1 time: 0.153592 Jun 15 14:58:51.585884 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 644/1262] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:51 2022] GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:52.602698 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-4e66b44a-445c-49fa-b621-417a02dc9252 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:52.603406 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-4e66b44a-445c-49fa-b621-417a02dc9252 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: 778183d7-2a3c-4534-9d9d-2cf519d3e898] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:52.610775 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4e66b44a-445c-49fa-b621-417a02dc9252 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:52.611226 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4e66b44a-445c-49fa-b621-417a02dc9252 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:52.612003 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4e66b44a-445c-49fa-b621-417a02dc9252 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:52.612444 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-4e66b44a-445c-49fa-b621-417a02dc9252 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:52.746698 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-4e66b44a-445c-49fa-b621-417a02dc9252 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182f01dd545c415f87920f17908dbc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8030c18a9947e3ad366c57f93b822c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:52.754284 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-4e66b44a-445c-49fa-b621-417a02dc9252 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898" status: 200 len: 1317 microversion: 2.1 time: 0.155843 Jun 15 14:58:52.754843 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 619/1263] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:52 2022] GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:53.771594 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-d6bd4cba-7f76-4767-9962-ab96d5c24fe2 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:53.772225 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-d6bd4cba-7f76-4767-9962-ab96d5c24fe2 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: 778183d7-2a3c-4534-9d9d-2cf519d3e898] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:53.774769 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=2 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:53.775528 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell0:SELECT=6 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:53.782076 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d6bd4cba-7f76-4767-9962-ab96d5c24fe2 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:53.782522 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d6bd4cba-7f76-4767-9962-ab96d5c24fe2 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:53.783307 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d6bd4cba-7f76-4767-9962-ab96d5c24fe2 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:53.783736 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-d6bd4cba-7f76-4767-9962-ab96d5c24fe2 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:53.914119 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-d6bd4cba-7f76-4767-9962-ab96d5c24fe2 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182f01dd545c415f87920f17908dbc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8030c18a9947e3ad366c57f93b822c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:53.922309 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-d6bd4cba-7f76-4767-9962-ab96d5c24fe2 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898" status: 200 len: 1506 microversion: 2.1 time: 0.154510 Jun 15 14:58:53.922869 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 645/1264] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:53 2022] GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:53.938405 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-b8d1f52d-fcd6-40be-88f0-a06012d4dfdb tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "983e0464-1bd8-4ada-bda1-6e4532c223a4", "device": "/dev/sdb"}} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:53.939514 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-b8d1f52d-fcd6-40be-88f0-a06012d4dfdb tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: 778183d7-2a3c-4534-9d9d-2cf519d3e898] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:53.941500 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell0:SELECT=2 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:53.947428 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b8d1f52d-fcd6-40be-88f0-a06012d4dfdb tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:53.947885 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b8d1f52d-fcd6-40be-88f0-a06012d4dfdb tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:53.948650 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b8d1f52d-fcd6-40be-88f0-a06012d4dfdb tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:53.949639 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-b8d1f52d-fcd6-40be-88f0-a06012d4dfdb tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:54.196696 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-b8d1f52d-fcd6-40be-88f0-a06012d4dfdb tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "POST /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262085 Jun 15 14:58:54.197313 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 620/1265] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 14:58:53 2022] POST /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:59:13.491306 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-68133202-d40b-4d33-8e15-48eea1dde6ff tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:13.491841 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-68133202-d40b-4d33-8e15-48eea1dde6ff tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: 778183d7-2a3c-4534-9d9d-2cf519d3e898] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:13.493687 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:13.494442 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG dbcounter [-] [124219] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=1 {{(pid=124219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:13.502421 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-68133202-d40b-4d33-8e15-48eea1dde6ff tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:13.502862 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-68133202-d40b-4d33-8e15-48eea1dde6ff tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:13.503621 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-68133202-d40b-4d33-8e15-48eea1dde6ff tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:13.504050 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-68133202-d40b-4d33-8e15-48eea1dde6ff tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:13.587462 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.objects.instance [None req-68133202-d40b-4d33-8e15-48eea1dde6ff tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lazy-loading 'services' on Instance uuid 778183d7-2a3c-4534-9d9d-2cf519d3e898 {{(pid=124219) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:59:13.658566 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-68133202-d40b-4d33-8e15-48eea1dde6ff tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "DELETE /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898/os-volume_attachments/983e0464-1bd8-4ada-bda1-6e4532c223a4" status: 202 len: 0 microversion: 2.1 time: 0.171090 Jun 15 14:59:13.659203 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 646/1266] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Jun 15 14:59:13 2022] DELETE /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898/os-volume_attachments/983e0464-1bd8-4ada-bda1-6e4532c223a4 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:59:14.769617 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:14.770468 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG dbcounter [-] [124220] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:14.775217 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-1c8fb62c-6358-4cf8-9d73-c811950bfa56 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:14.775804 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1c8fb62c-6358-4cf8-9d73-c811950bfa56 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: 778183d7-2a3c-4534-9d9d-2cf519d3e898] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:14.783902 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1c8fb62c-6358-4cf8-9d73-c811950bfa56 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:14.784449 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1c8fb62c-6358-4cf8-9d73-c811950bfa56 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:14.785344 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1c8fb62c-6358-4cf8-9d73-c811950bfa56 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:14.785921 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-1c8fb62c-6358-4cf8-9d73-c811950bfa56 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:14.812809 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-1c8fb62c-6358-4cf8-9d73-c811950bfa56 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: 778183d7-2a3c-4534-9d9d-2cf519d3e898] Going to try to terminate instance {{(pid=124220) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:59:14.887323 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-1c8fb62c-6358-4cf8-9d73-c811950bfa56 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "DELETE /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898" status: 204 len: 0 microversion: 2.1 time: 0.118936 Jun 15 14:59:14.888098 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 621/1267] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 14:59:14 2022] DELETE /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:59:14.898494 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-4a77fd6e-1691-46be-a13f-3531706160cf tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:14.899200 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-4a77fd6e-1691-46be-a13f-3531706160cf tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: 778183d7-2a3c-4534-9d9d-2cf519d3e898] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:14.905521 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4a77fd6e-1691-46be-a13f-3531706160cf tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:14.906010 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4a77fd6e-1691-46be-a13f-3531706160cf tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:14.906776 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4a77fd6e-1691-46be-a13f-3531706160cf tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:14.907217 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-4a77fd6e-1691-46be-a13f-3531706160cf tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:15.040894 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-4a77fd6e-1691-46be-a13f-3531706160cf tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182f01dd545c415f87920f17908dbc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8030c18a9947e3ad366c57f93b822c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:15.049033 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-4a77fd6e-1691-46be-a13f-3531706160cf tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898" status: 200 len: 1512 microversion: 2.1 time: 0.155318 Jun 15 14:59:15.049630 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 647/1268] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:14 2022] GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:16.066867 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [None req-fc97005d-28bd-4f0b-a405-3ae295992041 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:16.067562 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.compute.api [None req-fc97005d-28bd-4f0b-a405-3ae295992041 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: 778183d7-2a3c-4534-9d9d-2cf519d3e898] Fetching instance by UUID {{(pid=124220) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:16.073981 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fc97005d-28bd-4f0b-a405-3ae295992041 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:16.074426 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fc97005d-28bd-4f0b-a405-3ae295992041 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:16.075177 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fc97005d-28bd-4f0b-a405-3ae295992041 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:16.075609 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [None req-fc97005d-28bd-4f0b-a405-3ae295992041 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:16.203240 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.policy [None req-fc97005d-28bd-4f0b-a405-3ae295992041 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182f01dd545c415f87920f17908dbc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8030c18a9947e3ad366c57f93b822c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124220) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:16.210729 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [None req-fc97005d-28bd-4f0b-a405-3ae295992041 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898" status: 200 len: 1512 microversion: 2.1 time: 0.148114 Jun 15 14:59:16.211290 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 622/1269] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:16 2022] GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898 => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:17.228168 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-c4f19219-6457-4aa1-93d0-4b3c884a5c7f tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:17.228743 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-c4f19219-6457-4aa1-93d0-4b3c884a5c7f tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: 778183d7-2a3c-4534-9d9d-2cf519d3e898] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:17.235841 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c4f19219-6457-4aa1-93d0-4b3c884a5c7f tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:17.236293 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c4f19219-6457-4aa1-93d0-4b3c884a5c7f tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:17.237063 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c4f19219-6457-4aa1-93d0-4b3c884a5c7f tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:17.237506 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-c4f19219-6457-4aa1-93d0-4b3c884a5c7f tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:17.477469 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG nova.api.openstack.wsgi [req-8c2166db-3dcb-4741-911b-c52190a7a1c0 req-bec60988-18df-4cd2-978b-c2d86b3e89a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "778183d7-2a3c-4534-9d9d-2cf519d3e898", "name": "network-vif-deleted", "tag": "0ed5c056-af62-4b79-b51b-244eb0a402f7"}]} {{(pid=124220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:59:17.482386 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.policy [None req-c4f19219-6457-4aa1-93d0-4b3c884a5c7f tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182f01dd545c415f87920f17908dbc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8030c18a9947e3ad366c57f93b822c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124219) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:17.487046 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-8c2166db-3dcb-4741-911b-c52190a7a1c0 req-bec60988-18df-4cd2-978b-c2d86b3e89a0 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:17.487562 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: DEBUG oslo_concurrency.lockutils [req-8c2166db-3dcb-4741-911b-c52190a7a1c0 req-bec60988-18df-4cd2-978b-c2d86b3e89a0 service nova] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:17.490686 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-c4f19219-6457-4aa1-93d0-4b3c884a5c7f tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898" status: 200 len: 1512 microversion: 2.1 time: 0.266443 Jun 15 14:59:17.491261 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 648/1270] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:17 2022] GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898 => generated 1512 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:17.499451 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.compute.server_external_events [req-8c2166db-3dcb-4741-911b-c52190a7a1c0 req-bec60988-18df-4cd2-978b-c2d86b3e89a0 service nova] Creating event network-vif-deleted:0ed5c056-af62-4b79-b51b-244eb0a402f7 for instance 778183d7-2a3c-4534-9d9d-2cf519d3e898 on hv-cinder-84327 Jun 15 14:59:17.504609 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO nova.api.openstack.requestlog [req-8c2166db-3dcb-4741-911b-c52190a7a1c0 req-bec60988-18df-4cd2-978b-c2d86b3e89a0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030833 Jun 15 14:59:17.505214 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: [pid: 124220|app: 0|req: 623/1271] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 14:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:59:18.508224 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-a6a5a010-4a6e-44a1-bd48-cdbe3d1c7767 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Calling method '>' {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:18.508894 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.compute.api [None req-a6a5a010-4a6e-44a1-bd48-cdbe3d1c7767 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] [instance: 778183d7-2a3c-4534-9d9d-2cf519d3e898] Fetching instance by UUID {{(pid=124219) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:18.515910 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a6a5a010-4a6e-44a1-bd48-cdbe3d1c7767 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:18.516356 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a6a5a010-4a6e-44a1-bd48-cdbe3d1c7767 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:18.517103 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a6a5a010-4a6e-44a1-bd48-cdbe3d1c7767 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:18.517537 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG oslo_concurrency.lockutils [None req-a6a5a010-4a6e-44a1-bd48-cdbe3d1c7767 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Lock "2a02d676-298d-47a3-8b1e-38c9694b2603" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:18.531594 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.wsgi [None req-a6a5a010-4a6e-44a1-bd48-cdbe3d1c7767 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] HTTP exception thrown: Instance 778183d7-2a3c-4534-9d9d-2cf519d3e898 could not be found. Jun 15 14:59:18.533213 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-a6a5a010-4a6e-44a1-bd48-cdbe3d1c7767 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Request method failure captured: Jun 15 14:59:18.533213 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: request: GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898 HTTP/1.1 Jun 15 14:59:18.533213 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept: application/json Jun 15 14:59:18.533213 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Accept-Encoding: identity Jun 15 14:59:18.533213 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Connection: close Jun 15 14:59:18.533213 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Length: 0 Jun 15 14:59:18.533213 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Content-Type: application/json Jun 15 14:59:18.533213 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Host: 10.222.0.57 Jun 15 14:59:18.533213 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Openstack-System-Scope: None Jun 15 14:59:18.533213 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: User-Agent: python-urllib3/1.26.9 Jun 15 14:59:18.533213 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Auth-Token: gAAAAABiqfNiOH2050L4SPZ73b7dgIJIHJNTjL_h3-nLIwMVWSNRCe58uhBhdzr-doLkrECCCJuwBeLe-NH2OOvzmq93kWUp8fZgrLAt-cut04i5e791WwB1t-MbA6uFfdqIjXp128wUmfCQv-V1X32eYbg80desiGzVHJ8Im7ajId7fW6LLmQQ Jun 15 14:59:18.533213 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Id: None Jun 15 14:59:18.533213 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Domain-Name: None Jun 15 14:59:18.533213 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Identity-Status: Confirmed Jun 15 14:59:18.533213 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Is-Admin-Project: True Jun 15 14:59:18.533213 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Id: default Jun 15 14:59:18.533213 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Domain-Name: Default Jun 15 14:59:18.533213 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Id: 4a8030c18a9947e3ad366c57f93b822c Jun 15 14:59:18.533213 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Project-Name: tempest-VolumesSnapshotTestJSON-205823151 Jun 15 14:59:18.533213 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Role: member,reader Jun 15 14:59:18.533213 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Roles: member,reader Jun 15 14:59:18.534854 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a8030c18a9947e3ad366c57f93b822c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a8030c18a9947e3ad366c57f93b822c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a8030c18a9947e3ad366c57f93b822c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a8030c18a9947e3ad366c57f93b822c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 14:59:18.534854 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant: tempest-VolumesSnapshotTestJSON-205823151 Jun 15 14:59:18.534854 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Id: 4a8030c18a9947e3ad366c57f93b822c Jun 15 14:59:18.534854 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-205823151 Jun 15 14:59:18.534854 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User: tempest-VolumesSnapshotTestJSON-205823151-project Jun 15 14:59:18.534854 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Id: default Jun 15 14:59:18.534854 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Domain-Name: Default Jun 15 14:59:18.534854 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Id: 182f01dd545c415f87920f17908dbc20 Jun 15 14:59:18.534854 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: X-User-Name: tempest-VolumesSnapshotTestJSON-205823151-project Jun 15 14:59:18.534854 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: method: > Jun 15 14:59:18.534854 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: exception: Instance 778183d7-2a3c-4534-9d9d-2cf519d3e898 could not be found. Jun 15 14:59:18.534854 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: action_args: {'id': '778183d7-2a3c-4534-9d9d-2cf519d3e898'} Jun 15 14:59:18.535898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: {{(pid=124219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:59:18.535898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:59:18.535898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:59:18.535898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:59:18.535898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:59:18.535898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:59:18.535898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:59:18.535898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:59:18.535898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:59:18.535898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:59:18.535898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 778183d7-2a3c-4534-9d9d-2cf519d3e898 could not be found. Jun 15 14:59:18.535898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:59:18.535898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:59:18.535898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:59:18.535898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:59:18.535898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:59:18.535898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:59:18.535898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:59:18.535898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:59:18.535898 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:59:18.537719 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:59:18.537719 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:59:18.537719 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:59:18.537719 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:59:18.537719 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:59:18.537719 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:59:18.537719 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:59:18.537719 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 778183d7-2a3c-4534-9d9d-2cf519d3e898 could not be found. Jun 15 14:59:18.537719 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:59:18.537719 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:59:18.537719 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:59:18.537719 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:59:18.537719 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:59:18.537719 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:59:18.537719 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:59:18.537719 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:59:18.537719 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 778183d7-2a3c-4534-9d9d-2cf519d3e898 could not be found. Jun 15 14:59:18.537719 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: ERROR nova.api.openstack.wsgi Jun 15 14:59:18.539363 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: DEBUG nova.api.openstack.wsgi [None req-a6a5a010-4a6e-44a1-bd48-cdbe3d1c7767 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] Returning 404 to user: Instance 778183d7-2a3c-4534-9d9d-2cf519d3e898 could not be found. {{(pid=124219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:59:18.539363 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO nova.api.openstack.requestlog [None req-a6a5a010-4a6e-44a1-bd48-cdbe3d1c7767 tempest-VolumesSnapshotTestJSON-205823151 tempest-VolumesSnapshotTestJSON-205823151-project] 10.222.0.57 "GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898" status: 404 len: 111 microversion: 2.1 time: 0.030198 Jun 15 14:59:18.539363 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: [pid: 124219|app: 0|req: 649/1272] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:18 2022] GET /compute/v2.1/servers/778183d7-2a3c-4534-9d9d-2cf519d3e898 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:00:02.961383 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:00:02.962113 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Wed Jun 15 15:00:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:00:05.557961 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:00:05.558530 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Wed Jun 15 15:00:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:01:28.504121 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:01:28.504639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Wed Jun 15 15:01:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:01:33.266654 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:01:33.267220 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Wed Jun 15 15:01:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:01:48.132212 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:01:48.132983 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Wed Jun 15 15:01:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:01:59.347870 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:01:59.348485 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Wed Jun 15 15:01:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:03:22.970863 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:03:22.971639 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Wed Jun 15 15:03:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:03:25.566278 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:03:25.566740 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Wed Jun 15 15:03:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:04:48.512337 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:04:48.512945 dv-cinder-843277-3-iscsi devstack@n-api.service[124219]: Wed Jun 15 15:04:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:04:53.275630 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:04:53.276211 dv-cinder-843277-3-iscsi devstack@n-api.service[124220]: Wed Jun 15 15:04:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!